Apr 14 11:52:31 user nova-compute[71330]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 11:52:34 user nova-compute[71330]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71330) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 11:52:34 user nova-compute[71330]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71330) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 11:52:34 user nova-compute[71330]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71330) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 11:52:34 user nova-compute[71330]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 11:52:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:52:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:52:34 user nova-compute[71330]: INFO nova.virt.driver [None req-434c3d19-c597-4575-b901-154a73444329 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 11:52:34 user nova-compute[71330]: INFO nova.compute.provider_config [None req-434c3d19-c597-4575-b901-154a73444329 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 11:52:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-434c3d19-c597-4575-b901-154a73444329 None None] Acquiring lock "singleton_lock" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:52:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-434c3d19-c597-4575-b901-154a73444329 None None] Acquired lock "singleton_lock" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:52:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-434c3d19-c597-4575-b901-154a73444329 None None] Releasing lock "singleton_lock" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:52:34 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] Full set of CONF: {{(pid=71330) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 11:52:34 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ******************************************************************************** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 11:52:34 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] Configuration options gathered from: {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 11:52:34 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ================================================================================ {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] allow_resize_to_same_host      = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] arq_binding_timeout            = 300 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] backdoor_port                  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] backdoor_socket                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] block_device_allocate_retries  = 300 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] block_device_allocate_retries_interval = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cert                           = self.pem {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute_monitors               = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] config_dir                     = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] config_drive_format            = iso9660 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] config_source                  = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] console_host                   = user {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] control_exchange               = nova {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cpu_allocation_ratio           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] daemon                         = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] debug                          = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] default_access_ip_network_name = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] default_availability_zone      = nova {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] default_ephemeral_format       = ext4 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] default_schedule_zone          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] disk_allocation_ratio          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] enable_new_services            = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] enabled_ssl_apis               = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] flat_injected                  = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] force_config_drive             = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] force_raw_images               = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] graceful_shutdown_timeout      = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] heal_instance_info_cache_interval = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] host                           = user {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] instance_build_timeout         = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] instance_delete_interval       = 300 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] instance_name_template         = instance-%08x {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] instance_usage_audit           = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] instance_usage_audit_period    = month {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] internal_service_availability_zone = internal {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] key                            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] live_migration_retry_count     = 30 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] log_config_append              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] log_dir                        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] log_file                       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] log_options                    = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] log_rotate_interval            = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] log_rotate_interval_type       = days {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] log_rotation_type              = none {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] long_rpc_timeout               = 1800 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] max_concurrent_builds          = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] max_concurrent_live_migrations = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] max_concurrent_snapshots       = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] max_local_block_devices        = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] max_logfile_count              = 30 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] max_logfile_size_mb            = 200 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] maximum_instance_delete_attempts = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] metadata_listen                = 0.0.0.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] metadata_listen_port           = 8775 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] metadata_workers               = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] migrate_max_retries            = -1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] mkisofs_cmd                    = genisoimage {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] my_ip                          = 10.0.0.210 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] network_allocate_retries       = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] osapi_compute_listen_port      = 8774 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] osapi_compute_unique_server_name_scope =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] osapi_compute_workers          = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] password_length                = 12 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] periodic_enable                = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] periodic_fuzzy_delay           = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] pointer_model                  = ps2mouse {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] preallocate_images             = none {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] publish_errors                 = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] pybasedir                      = /opt/stack/nova {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ram_allocation_ratio           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] rate_limit_burst               = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] rate_limit_except_level        = CRITICAL {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] rate_limit_interval            = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] reboot_timeout                 = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] reclaim_instance_interval      = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] record                         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] reimage_timeout_per_gb         = 20 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] report_interval                = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] rescue_timeout                 = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] reserved_host_cpus             = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] reserved_host_disk_mb          = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] reserved_host_memory_mb        = 512 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] reserved_huge_pages            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] resize_confirm_window          = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] resize_fs_using_block_device   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] resume_guests_state_on_host_boot = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] rpc_response_timeout           = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] run_external_periodic_tasks    = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] running_deleted_instance_action = reap {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] running_deleted_instance_timeout = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler_instance_sync_interval = 120 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_down_time              = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] servicegroup_driver            = db {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] shelved_offload_time           = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] shelved_poll_interval          = 3600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] shutdown_timeout               = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] source_is_ipv6                 = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ssl_only                       = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] state_path                     = /opt/stack/data/nova {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] sync_power_state_interval      = 600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] sync_power_state_pool_size     = 1000 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] syslog_log_facility            = LOG_USER {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] tempdir                        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] timeout_nbd                    = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] transport_url                  = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] update_resources_interval      = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] use_cow_images                 = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] use_eventlog                   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] use_journal                    = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] use_json                       = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] use_rootwrap_daemon            = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] use_stderr                     = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] use_syslog                     = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vcpu_pin_set                   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plugging_is_fatal          = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plugging_timeout           = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] virt_mkfs                      = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] volume_usage_poll_interval     = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] watch_log_file                 = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] web                            = /usr/share/spice-html5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_concurrency.disable_process_locking = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.auth_strategy              = keystone {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.compute_link_prefix        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.dhcp_domain                = novalocal {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.enable_instance_password   = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.glance_link_prefix         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.instance_list_per_project_cells = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.list_records_by_skipping_down_cells = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.local_metadata_per_cell    = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.max_limit                  = 1000 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.metadata_cache_expiration  = 15 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.neutron_default_tenant_id  = default {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.use_forwarded_for          = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.use_neutron_default_nets   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.vendordata_dynamic_targets = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.vendordata_jsonfile_path   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.backend_argument         = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.config_prefix            = cache.oslo {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.dead_timeout             = 60.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.debug_cache_backend      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.enable_retry_client      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.enable_socket_keepalive  = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.enabled                  = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.expiration_time          = 600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.hashclient_retry_attempts = 2 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_dead_retry      = 300 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_password        =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_sasl_enabled    = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.memcache_username        =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.proxies                  = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.retry_attempts           = 2 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.retry_delay              = 0.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.socket_keepalive_count   = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.socket_keepalive_idle    = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.socket_keepalive_interval = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.tls_allowed_ciphers      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.tls_cafile               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.tls_certfile             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.tls_enabled              = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cache.tls_keyfile              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.auth_section            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.auth_type               = password {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.cafile                  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.certfile                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.collect_timing          = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.cross_az_attach         = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.debug                   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.endpoint_template       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.http_retries            = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.insecure                = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.keyfile                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.os_region_name          = RegionOne {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.split_loggers           = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cinder.timeout                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.cpu_dedicated_set      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.cpu_shared_set         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.image_type_exclude_list = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.resource_provider_association_refresh = 300 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.shutdown_retry_interval = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] conductor.workers              = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] console.allowed_origins        = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] console.ssl_ciphers            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] console.ssl_minimum_version    = default {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] consoleauth.token_ttl          = 600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.cafile                  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.certfile                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.collect_timing          = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.connect_retries         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.connect_retry_delay     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.endpoint_override       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.insecure                = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.keyfile                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.max_version             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.min_version             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.region_name             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.service_name            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.service_type            = accelerator {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.split_loggers           = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.status_code_retries     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.status_code_retry_delay = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.timeout                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] cyborg.version                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.backend               = sqlalchemy {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.connection            = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.connection_debug      = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.connection_parameters =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.connection_recycle_time = 3600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.connection_trace      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.db_inc_retry_interval = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.db_max_retries        = 20 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.db_max_retry_interval = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.db_retry_interval     = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.max_overflow          = 50 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.max_pool_size         = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.max_retries           = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.mysql_enable_ndb      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.mysql_wsrep_sync_wait = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.pool_timeout          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.retry_interval        = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.slave_connection      = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] database.sqlite_synchronous    = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.backend           = sqlalchemy {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.connection        = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.connection_debug  = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.connection_parameters =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.connection_recycle_time = 3600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.connection_trace  = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.db_inc_retry_interval = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.db_max_retries    = 20 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.db_max_retry_interval = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.db_retry_interval = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.max_overflow      = 50 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.max_pool_size     = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.max_retries       = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.mysql_enable_ndb  = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.pool_timeout      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.retry_interval    = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.slave_connection  = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] api_database.sqlite_synchronous = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] devices.enabled_mdev_types     = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ephemeral_storage_encryption.enabled = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.api_servers             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.cafile                  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.certfile                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.collect_timing          = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.connect_retries         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.connect_retry_delay     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.debug                   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.default_trusted_certificate_ids = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.enable_certificate_validation = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.enable_rbd_download     = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.endpoint_override       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.insecure                = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.keyfile                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.max_version             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.min_version             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.num_retries             = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.rbd_ceph_conf           =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.rbd_connect_timeout     = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.rbd_pool                =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.rbd_user                =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.region_name             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.service_name            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.service_type            = image {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.split_loggers           = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.status_code_retries     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.status_code_retry_delay = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.timeout                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.verify_glance_signatures = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] glance.version                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] guestfs.debug                  = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.config_drive_cdrom      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.config_drive_inject_password = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.enable_remotefx         = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.instances_path_share    =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.limit_cpu_features      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.use_multipath_io        = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.vswitch_name            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] mks.enabled                    = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] image_cache.manager_interval   = 2400 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] image_cache.precache_concurrency = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] image_cache.remove_unused_base_images = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] image_cache.subdirectory_name  = _base {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.api_max_retries         = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.api_retry_interval      = 2 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.auth_section            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.auth_type               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.cafile                  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.certfile                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.collect_timing          = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.connect_retries         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.connect_retry_delay     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.endpoint_override       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.insecure                = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.keyfile                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.max_version             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.min_version             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.partition_key           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.peer_list               = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.region_name             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.serial_console_state_timeout = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.service_name            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.service_type            = baremetal {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.split_loggers           = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.status_code_retries     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.status_code_retry_delay = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.timeout                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ironic.version                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] key_manager.fixed_key          = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.barbican_api_version  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.barbican_endpoint     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.barbican_endpoint_type = public {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.barbican_region_name  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.cafile                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.certfile              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.collect_timing        = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.insecure              = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.keyfile               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.number_of_retries     = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.retry_delay           = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.send_service_user_token = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.split_loggers         = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.timeout               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.verify_ssl            = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican.verify_ssl_path       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican_service_user.auth_section = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican_service_user.auth_type = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican_service_user.cafile   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican_service_user.certfile = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican_service_user.collect_timing = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican_service_user.insecure = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican_service_user.keyfile  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican_service_user.split_loggers = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] barbican_service_user.timeout  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.approle_role_id          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.approle_secret_id        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.cafile                   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.certfile                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.collect_timing           = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.insecure                 = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.keyfile                  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.kv_mountpoint            = secret {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.kv_version               = 2 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.namespace                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.root_token_id            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.split_loggers            = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.ssl_ca_crt_file          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.timeout                  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.use_ssl                  = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.cafile                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.certfile              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.collect_timing        = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.connect_retries       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.connect_retry_delay   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.endpoint_override     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.insecure              = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.keyfile               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.max_version           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.min_version           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.region_name           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.service_name          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.service_type          = identity {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.split_loggers         = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.status_code_retries   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.status_code_retry_delay = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.timeout               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] keystone.version               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.connection_uri         =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.cpu_mode               = custom {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: WARNING oslo_config.cfg [None req-434c3d19-c597-4575-b901-154a73444329 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.cpu_power_governor_high = performance {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.cpu_power_management   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.device_detach_attempts = 8 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.device_detach_timeout  = 20 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.disk_cachemodes        = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.disk_prefix            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.enabled_perf_events    = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.file_backed_memory     = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.gid_maps               = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.hw_disk_discard        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.hw_machine_type        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.images_rbd_pool        = rbd {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.images_type            = default {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.images_volume_group    = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.inject_key             = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.inject_partition       = -2 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.inject_password        = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.iscsi_iface            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.iser_use_multipath     = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_downtime = 500 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_inbound_addr = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_scheme  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_timeout_action = abort {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_tunnelled = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: WARNING oslo_config.cfg [None req-434c3d19-c597-4575-b901-154a73444329 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 11:52:35 user nova-compute[71330]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 11:52:35 user nova-compute[71330]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 11:52:35 user nova-compute[71330]: and ``live_migration_inbound_addr`` respectively.
Apr 14 11:52:35 user nova-compute[71330]: ).  Its value may be silently ignored in the future.
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.live_migration_with_native_tls = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.max_queues             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.nfs_mount_options      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.num_pcie_ports         = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.pmem_namespaces        = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.quobyte_client_cfg     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rbd_secret_uuid        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rbd_user               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rescue_image_id        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rescue_kernel_id       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.rx_queue_size          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.smbfs_mount_options    =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.snapshot_compression   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.snapshot_image_format  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.sparse_logical_volumes = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.swtpm_enabled          = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.swtpm_group            = tss {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.swtpm_user             = tss {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.sysinfo_serial         = unique {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.tx_queue_size          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.uid_maps               = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.use_virtio_for_bridges = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.virt_type              = kvm {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.volume_clear           = zero {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.volume_clear_size      = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.volume_use_multipath   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.vzstorage_cache_path   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.auth_section           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.auth_type              = password {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.cafile                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.certfile               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.collect_timing         = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.connect_retries        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.connect_retry_delay    = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.default_floating_pool  = public {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.endpoint_override      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.extension_sync_interval = 600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.http_retries           = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.insecure               = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.keyfile                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.max_version            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.min_version            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.ovs_bridge             = br-int {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.physnets               = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.region_name            = RegionOne {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.service_metadata_proxy = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.service_name           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.service_type           = network {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.split_loggers          = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.status_code_retries    = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.status_code_retry_delay = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.timeout                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] neutron.version                = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] notifications.bdms_in_notifications = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] notifications.default_level    = INFO {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] notifications.notification_format = unversioned {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] notifications.notify_on_state_change = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] pci.alias                      = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] pci.device_spec                = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] pci.report_in_placement        = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.auth_section         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.auth_type            = password {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.cafile               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.certfile             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.collect_timing       = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.connect_retries      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.connect_retry_delay  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.default_domain_id    = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.default_domain_name  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.domain_id            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.domain_name          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.endpoint_override    = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.insecure             = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.keyfile              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.max_version          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.min_version          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.password             = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.project_domain_id    = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.project_domain_name  = Default {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.project_id           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.project_name         = service {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.region_name          = RegionOne {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.service_name         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.service_type         = placement {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.split_loggers        = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.status_code_retries  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.status_code_retry_delay = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.system_scope         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.timeout              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.trust_id             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.user_domain_id       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.user_domain_name     = Default {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.user_id              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.username             = placement {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] placement.version              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.cores                    = 20 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.count_usage_from_placement = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.injected_file_content_bytes = 10240 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.injected_file_path_length = 255 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.injected_files           = 5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.instances                = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.key_pairs                = 100 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.metadata_items           = 128 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.ram                      = 51200 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.recheck_quota            = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.server_group_members     = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] quota.server_groups            = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] rdp.enabled                    = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.image_metadata_prefilter = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.max_attempts         = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.max_placement_results = 1000 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] scheduler.workers              = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.host_subset_size = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.isolated_hosts = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.isolated_images = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.pci_in_placement = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.track_instance_changes = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] metrics.required               = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] metrics.weight_multiplier      = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] metrics.weight_setting         = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] serial_console.enabled         = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] serial_console.port_range      = 10000:20000 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] serial_console.serialproxy_port = 6083 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.auth_section      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.auth_type         = password {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.cafile            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.certfile          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.collect_timing    = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.insecure          = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.keyfile           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.send_service_user_token = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.split_loggers     = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] service_user.timeout           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.agent_enabled            = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.enabled                  = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.html5proxy_port          = 6082 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.image_compression        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.jpeg_compression         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.playback_compression     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.server_listen            = 127.0.0.1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.streaming_mode           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] spice.zlib_compression         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] upgrade_levels.baseapi         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] upgrade_levels.cert            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] upgrade_levels.compute         = auto {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] upgrade_levels.conductor       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] upgrade_levels.scheduler       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vendordata_dynamic_auth.cafile = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vendordata_dynamic_auth.certfile = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vendordata_dynamic_auth.insecure = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vendordata_dynamic_auth.timeout = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.api_retry_count         = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.ca_file                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.cache_prefix            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.cluster_name            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.connection_pool_size    = 10 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.console_delay_seconds   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.datastore_regex         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.host_ip                 = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.host_password           = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.host_port               = 443 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.host_username           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.insecure                = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.integration_bridge      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.maximum_objects         = 100 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.pbm_default_policy      = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.pbm_enabled             = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.pbm_wsdl_location       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.serial_port_proxy_uri   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.serial_port_service_uri = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.task_poll_interval      = 0.5 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.use_linked_clone        = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.vnc_keymap              = en-us {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.vnc_port                = 5900 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vmware.vnc_port_total          = 10000 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.auth_schemes               = ['none'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.enabled                    = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.novncproxy_port            = 6080 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.vencrypt_ca_certs          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.vencrypt_client_cert       = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vnc.vencrypt_client_key        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.disable_rootwrap   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.enable_numa_live_migration = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.libvirt_disable_apic = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.client_socket_timeout     = 900 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.default_pool_size         = 1000 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.keep_alive                = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.max_header_line           = 16384 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.ssl_ca_file               = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.ssl_cert_file             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.ssl_key_file              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.tcp_keepidle              = 600 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] zvm.ca_file                    = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] zvm.cloud_connector_url        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] zvm.reachable_timeout          = 300 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.enforce_new_defaults = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.enforce_scope      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.policy_default_rule = default {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.connection_string     = messaging:// {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.enabled               = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.es_doc_type           = notification {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.es_scroll_size        = 10000 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.es_scroll_time        = 2m {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.filter_error_trace    = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.sentinel_service_name = mymaster {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.socket_timeout        = 0.1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] profiler.trace_sqlalchemy      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] remote_debug.host              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] remote_debug.port              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_notifications.retry = -1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.auth_section        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.auth_type           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.cafile              = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.certfile            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.collect_timing      = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.connect_retries     = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.connect_retry_delay = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.endpoint_id         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.endpoint_override   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.insecure            = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.keyfile             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.max_version         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.min_version         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.region_name         = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.service_name        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.service_type        = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.split_loggers       = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.status_code_retries = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.status_code_retry_delay = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.timeout             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.valid_interfaces    = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_limit.version             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_reports.file_event_handler = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] oslo_reports.log_dir           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_ovs_privileged.group  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] vif_plug_ovs_privileged.user   = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_ovs.isolate_vif         = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] os_brick.lock_path             = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] privsep_osbrick.capabilities   = [21] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] privsep_osbrick.group          = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] privsep_osbrick.helper_command = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] privsep_osbrick.user           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] nova_sys_admin.group           = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] nova_sys_admin.helper_command  = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] nova_sys_admin.user            = None {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG oslo_service.service [None req-434c3d19-c597-4575-b901-154a73444329 None None] ******************************************************************************** {{(pid=71330) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 11:52:35 user nova-compute[71330]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 11:52:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Starting native event thread {{(pid=71330) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Starting green dispatch thread {{(pid=71330) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Starting connection event dispatch thread {{(pid=71330) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Connecting to libvirt: qemu:///system {{(pid=71330) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f495ebc6680> {{(pid=71330) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 11:52:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f495ebc6680> {{(pid=71330) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 11:52:35 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Connection event '1' reason 'None'
Apr 14 11:52:35 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 11:52:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.mount [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Initialising _HostMountState generation 0 {{(pid=71330) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 11:52:43 user nova-compute[71330]: INFO nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt host capabilities <capabilities>
Apr 14 11:52:43 user nova-compute[71330]:   <host>
Apr 14 11:52:43 user nova-compute[71330]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 11:52:43 user nova-compute[71330]:     <cpu>
Apr 14 11:52:43 user nova-compute[71330]:       <arch>x86_64</arch>
Apr 14 11:52:43 user nova-compute[71330]:       <model>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <vendor>Intel</vendor>
Apr 14 11:52:43 user nova-compute[71330]:       <microcode version='1070'/>
Apr 14 11:52:43 user nova-compute[71330]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 11:52:43 user nova-compute[71330]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='ss'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='vmx'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='pcid'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='osxsave'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='hypervisor'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='arat'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='tsc_adjust'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='md-clear'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='arch-capabilities'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='invtsc'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='rsba'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 11:52:43 user nova-compute[71330]:       <pages unit='KiB' size='4'/>
Apr 14 11:52:43 user nova-compute[71330]:       <pages unit='KiB' size='2048'/>
Apr 14 11:52:43 user nova-compute[71330]:     </cpu>
Apr 14 11:52:43 user nova-compute[71330]:     <power_management>
Apr 14 11:52:43 user nova-compute[71330]:       <suspend_mem/>
Apr 14 11:52:43 user nova-compute[71330]:       <suspend_disk/>
Apr 14 11:52:43 user nova-compute[71330]:       <suspend_hybrid/>
Apr 14 11:52:43 user nova-compute[71330]:     </power_management>
Apr 14 11:52:43 user nova-compute[71330]:     <iommu support='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     <migration_features>
Apr 14 11:52:43 user nova-compute[71330]:       <live/>
Apr 14 11:52:43 user nova-compute[71330]:       <uri_transports>
Apr 14 11:52:43 user nova-compute[71330]:         <uri_transport>tcp</uri_transport>
Apr 14 11:52:43 user nova-compute[71330]:         <uri_transport>rdma</uri_transport>
Apr 14 11:52:43 user nova-compute[71330]:       </uri_transports>
Apr 14 11:52:43 user nova-compute[71330]:     </migration_features>
Apr 14 11:52:43 user nova-compute[71330]:     <topology>
Apr 14 11:52:43 user nova-compute[71330]:       <cells num='2'>
Apr 14 11:52:43 user nova-compute[71330]:         <cell id='0'>
Apr 14 11:52:43 user nova-compute[71330]:           <memory unit='KiB'>8189224</memory>
Apr 14 11:52:43 user nova-compute[71330]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 14 11:52:43 user nova-compute[71330]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 11:52:43 user nova-compute[71330]:           <distances>
Apr 14 11:52:43 user nova-compute[71330]:             <sibling id='0' value='10'/>
Apr 14 11:52:43 user nova-compute[71330]:             <sibling id='1' value='20'/>
Apr 14 11:52:43 user nova-compute[71330]:           </distances>
Apr 14 11:52:43 user nova-compute[71330]:           <cpus num='6'>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 11:52:43 user nova-compute[71330]:           </cpus>
Apr 14 11:52:43 user nova-compute[71330]:         </cell>
Apr 14 11:52:43 user nova-compute[71330]:         <cell id='1'>
Apr 14 11:52:43 user nova-compute[71330]:           <memory unit='KiB'>8218764</memory>
Apr 14 11:52:43 user nova-compute[71330]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 14 11:52:43 user nova-compute[71330]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 11:52:43 user nova-compute[71330]:           <distances>
Apr 14 11:52:43 user nova-compute[71330]:             <sibling id='0' value='20'/>
Apr 14 11:52:43 user nova-compute[71330]:             <sibling id='1' value='10'/>
Apr 14 11:52:43 user nova-compute[71330]:           </distances>
Apr 14 11:52:43 user nova-compute[71330]:           <cpus num='6'>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 11:52:43 user nova-compute[71330]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 11:52:43 user nova-compute[71330]:           </cpus>
Apr 14 11:52:43 user nova-compute[71330]:         </cell>
Apr 14 11:52:43 user nova-compute[71330]:       </cells>
Apr 14 11:52:43 user nova-compute[71330]:     </topology>
Apr 14 11:52:43 user nova-compute[71330]:     <cache>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 11:52:43 user nova-compute[71330]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 11:52:43 user nova-compute[71330]:     </cache>
Apr 14 11:52:43 user nova-compute[71330]:     <secmodel>
Apr 14 11:52:43 user nova-compute[71330]:       <model>apparmor</model>
Apr 14 11:52:43 user nova-compute[71330]:       <doi>0</doi>
Apr 14 11:52:43 user nova-compute[71330]:     </secmodel>
Apr 14 11:52:43 user nova-compute[71330]:     <secmodel>
Apr 14 11:52:43 user nova-compute[71330]:       <model>dac</model>
Apr 14 11:52:43 user nova-compute[71330]:       <doi>0</doi>
Apr 14 11:52:43 user nova-compute[71330]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 11:52:43 user nova-compute[71330]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 11:52:43 user nova-compute[71330]:     </secmodel>
Apr 14 11:52:43 user nova-compute[71330]:   </host>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='alpha'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>clipper</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='armv6l'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>spitz</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>nuri</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>kzm</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sx1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>z2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>tosa</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>n810</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>n800</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>terrier</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>midway</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>microbit</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>verdex</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>highbank</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>akita</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>connex</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>collie</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='armv7l'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>spitz</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>nuri</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>kzm</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sx1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>z2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>tosa</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>n810</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>n800</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>terrier</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>midway</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>microbit</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>verdex</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>highbank</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>akita</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>connex</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>collie</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='aarch64'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>spitz</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>nuri</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>kzm</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sx1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>z2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>tosa</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>n810</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>n800</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>terrier</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>midway</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>microbit</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>verdex</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>highbank</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>akita</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>connex</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>collie</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <acpi default='on' toggle='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='cris'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='i686'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>isapc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>microvm</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='kvm'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <pae/>
Apr 14 11:52:43 user nova-compute[71330]:       <nonpae/>
Apr 14 11:52:43 user nova-compute[71330]:       <acpi default='on' toggle='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:       <apic default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='m68k'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>an5206</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>q800</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='microblaze'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='microblazeel'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='mips'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='16'>malta</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='mipsel'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='16'>malta</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='mips64'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='16'>malta</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>pica61</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>magnum</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='mips64el'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='16'>malta</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>pica61</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>magnum</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='16'>boston</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='ppc'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mac99</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>40p</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>taihu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='ppc64'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>taihu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>40p</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mac99</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='ppc64le'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>taihu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>40p</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>mac99</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='riscv32'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='8'>spike</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='8'>virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='riscv64'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='8'>spike</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='8'>virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='s390x'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='sh4'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>shix</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>r2d</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='sh4eb'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>shix</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>r2d</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='sparc'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>LX</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='sparc64'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>niagara</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='x86_64'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>64</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='1'>isapc</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>microvm</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='kvm'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <acpi default='on' toggle='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:       <apic default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='xtensa'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>sim</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>kc705</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>ml605</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>lx200</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>lx60</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]:   <guest>
Apr 14 11:52:43 user nova-compute[71330]:     <os_type>hvm</os_type>
Apr 14 11:52:43 user nova-compute[71330]:     <arch name='xtensaeb'>
Apr 14 11:52:43 user nova-compute[71330]:       <wordsize>32</wordsize>
Apr 14 11:52:43 user nova-compute[71330]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='4'>sim</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>kc705</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>ml605</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>virt</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>lx200</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>lx60</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 11:52:43 user nova-compute[71330]:       <domain type='qemu'/>
Apr 14 11:52:43 user nova-compute[71330]:     </arch>
Apr 14 11:52:43 user nova-compute[71330]:     <features>
Apr 14 11:52:43 user nova-compute[71330]:       <cpuselection/>
Apr 14 11:52:43 user nova-compute[71330]:       <deviceboot/>
Apr 14 11:52:43 user nova-compute[71330]:       <disksnapshot default='on' toggle='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     </features>
Apr 14 11:52:43 user nova-compute[71330]:   </guest>
Apr 14 11:52:43 user nova-compute[71330]: </capabilities>
Apr 14 11:52:43 user nova-compute[71330]: 
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 11:52:43 user nova-compute[71330]: <domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 11:52:43 user nova-compute[71330]:   <domain>kvm</domain>
Apr 14 11:52:43 user nova-compute[71330]:   <machine>pc-i440fx-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:   <arch>i686</arch>
Apr 14 11:52:43 user nova-compute[71330]:   <vcpu max='255'/>
Apr 14 11:52:43 user nova-compute[71330]:   <iothreads supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:   <os supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='firmware'/>
Apr 14 11:52:43 user nova-compute[71330]:     <loader supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>rom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pflash</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='readonly'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='secure'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </loader>
Apr 14 11:52:43 user nova-compute[71330]:   </os>
Apr 14 11:52:43 user nova-compute[71330]:   <cpu>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-passthrough' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='hostPassthroughMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='maximum' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='maximumMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-model' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <vendor>Intel</vendor>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ss'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='vmx'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pcid'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='hypervisor'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arat'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='umip'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='md-clear'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibpb'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibrs'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='erms'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='lm'/>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='custom' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>qemu64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>qemu32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>phenom</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>n270</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>kvm64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>coreduo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>core2duo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>athlon</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Westmere</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Snowridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Penryn</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G5</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G4</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G1</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Nehalem</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Rome</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Milan</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Dhyana</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cooperlake</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Conroe</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>486</model>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:   </cpu>
Apr 14 11:52:43 user nova-compute[71330]:   <memoryBacking supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='sourceType'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>file</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>anonymous</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>memfd</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:   </memoryBacking>
Apr 14 11:52:43 user nova-compute[71330]:   <devices>
Apr 14 11:52:43 user nova-compute[71330]:     <disk supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='diskDevice'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>disk</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cdrom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>floppy</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>lun</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='bus'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ide</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>fdc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sata</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </disk>
Apr 14 11:52:43 user nova-compute[71330]:     <graphics supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sdl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vnc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>spice</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egl-headless</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </graphics>
Apr 14 11:52:43 user nova-compute[71330]:     <video supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='modelType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cirrus</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vmvga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>qxl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>none</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>bochs</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ramfb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </video>
Apr 14 11:52:43 user nova-compute[71330]:     <hostdev supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='mode'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>subsystem</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='startupPolicy'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>default</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>mandatory</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>requisite</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>optional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='subsysType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pci</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='capsType'/>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='pciBackend'/>
Apr 14 11:52:43 user nova-compute[71330]:     </hostdev>
Apr 14 11:52:43 user nova-compute[71330]:     <rng supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>random</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egd</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>builtin</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </rng>
Apr 14 11:52:43 user nova-compute[71330]:     <filesystem supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='driverType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>path</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>handle</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtiofs</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </filesystem>
Apr 14 11:52:43 user nova-compute[71330]:     <tpm supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-tis</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-crb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>passthrough</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>emulator</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </tpm>
Apr 14 11:52:43 user nova-compute[71330]:   </devices>
Apr 14 11:52:43 user nova-compute[71330]:   <features>
Apr 14 11:52:43 user nova-compute[71330]:     <gic supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     <vmcoreinfo supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <genid supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backingStoreInput supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backup supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <sev supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:   </features>
Apr 14 11:52:43 user nova-compute[71330]: </domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:  {{(pid=71330) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 11:52:43 user nova-compute[71330]: <domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 11:52:43 user nova-compute[71330]:   <domain>kvm</domain>
Apr 14 11:52:43 user nova-compute[71330]:   <machine>pc-q35-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:   <arch>i686</arch>
Apr 14 11:52:43 user nova-compute[71330]:   <vcpu max='288'/>
Apr 14 11:52:43 user nova-compute[71330]:   <iothreads supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:   <os supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='firmware'/>
Apr 14 11:52:43 user nova-compute[71330]:     <loader supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>rom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pflash</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='readonly'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='secure'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </loader>
Apr 14 11:52:43 user nova-compute[71330]:   </os>
Apr 14 11:52:43 user nova-compute[71330]:   <cpu>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-passthrough' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='hostPassthroughMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='maximum' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='maximumMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-model' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <vendor>Intel</vendor>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ss'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='vmx'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pcid'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='hypervisor'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arat'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='umip'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='md-clear'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibpb'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibrs'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='erms'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='lm'/>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='custom' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>qemu64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>qemu32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>phenom</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>n270</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>kvm64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>coreduo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>core2duo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>athlon</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Westmere</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Snowridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Penryn</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G5</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G4</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G1</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Nehalem</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Rome</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Milan</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Dhyana</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cooperlake</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Conroe</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>486</model>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:   </cpu>
Apr 14 11:52:43 user nova-compute[71330]:   <memoryBacking supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='sourceType'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>file</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>anonymous</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>memfd</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:   </memoryBacking>
Apr 14 11:52:43 user nova-compute[71330]:   <devices>
Apr 14 11:52:43 user nova-compute[71330]:     <disk supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='diskDevice'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>disk</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cdrom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>floppy</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>lun</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='bus'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>fdc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sata</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </disk>
Apr 14 11:52:43 user nova-compute[71330]:     <graphics supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sdl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vnc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>spice</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egl-headless</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </graphics>
Apr 14 11:52:43 user nova-compute[71330]:     <video supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='modelType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cirrus</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vmvga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>qxl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>none</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>bochs</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ramfb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </video>
Apr 14 11:52:43 user nova-compute[71330]:     <hostdev supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='mode'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>subsystem</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='startupPolicy'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>default</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>mandatory</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>requisite</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>optional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='subsysType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pci</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='capsType'/>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='pciBackend'/>
Apr 14 11:52:43 user nova-compute[71330]:     </hostdev>
Apr 14 11:52:43 user nova-compute[71330]:     <rng supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>random</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egd</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>builtin</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </rng>
Apr 14 11:52:43 user nova-compute[71330]:     <filesystem supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='driverType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>path</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>handle</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtiofs</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </filesystem>
Apr 14 11:52:43 user nova-compute[71330]:     <tpm supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-tis</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-crb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>passthrough</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>emulator</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </tpm>
Apr 14 11:52:43 user nova-compute[71330]:   </devices>
Apr 14 11:52:43 user nova-compute[71330]:   <features>
Apr 14 11:52:43 user nova-compute[71330]:     <gic supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     <vmcoreinfo supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <genid supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backingStoreInput supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backup supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <sev supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:   </features>
Apr 14 11:52:43 user nova-compute[71330]: </domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:  {{(pid=71330) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 11:52:43 user nova-compute[71330]: <domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 11:52:43 user nova-compute[71330]:   <domain>kvm</domain>
Apr 14 11:52:43 user nova-compute[71330]:   <machine>pc-i440fx-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:   <arch>i686</arch>
Apr 14 11:52:43 user nova-compute[71330]:   <vcpu max='255'/>
Apr 14 11:52:43 user nova-compute[71330]:   <iothreads supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:   <os supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='firmware'/>
Apr 14 11:52:43 user nova-compute[71330]:     <loader supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>rom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pflash</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='readonly'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='secure'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </loader>
Apr 14 11:52:43 user nova-compute[71330]:   </os>
Apr 14 11:52:43 user nova-compute[71330]:   <cpu>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-passthrough' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='hostPassthroughMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='maximum' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='maximumMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-model' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <vendor>Intel</vendor>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ss'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='vmx'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pcid'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='hypervisor'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arat'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='umip'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='md-clear'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibpb'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibrs'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='erms'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='lm'/>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='custom' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>qemu64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>qemu32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>phenom</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>n270</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>kvm64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>coreduo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>core2duo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>athlon</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Westmere</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Snowridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Penryn</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G5</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G4</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G1</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Nehalem</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Rome</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Milan</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Dhyana</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cooperlake</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Conroe</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>486</model>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:   </cpu>
Apr 14 11:52:43 user nova-compute[71330]:   <memoryBacking supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='sourceType'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>file</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>anonymous</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>memfd</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:   </memoryBacking>
Apr 14 11:52:43 user nova-compute[71330]:   <devices>
Apr 14 11:52:43 user nova-compute[71330]:     <disk supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='diskDevice'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>disk</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cdrom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>floppy</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>lun</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='bus'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ide</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>fdc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sata</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </disk>
Apr 14 11:52:43 user nova-compute[71330]:     <graphics supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sdl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vnc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>spice</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egl-headless</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </graphics>
Apr 14 11:52:43 user nova-compute[71330]:     <video supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='modelType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cirrus</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vmvga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>qxl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>none</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>bochs</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ramfb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </video>
Apr 14 11:52:43 user nova-compute[71330]:     <hostdev supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='mode'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>subsystem</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='startupPolicy'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>default</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>mandatory</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>requisite</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>optional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='subsysType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pci</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='capsType'/>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='pciBackend'/>
Apr 14 11:52:43 user nova-compute[71330]:     </hostdev>
Apr 14 11:52:43 user nova-compute[71330]:     <rng supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>random</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egd</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>builtin</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </rng>
Apr 14 11:52:43 user nova-compute[71330]:     <filesystem supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='driverType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>path</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>handle</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtiofs</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </filesystem>
Apr 14 11:52:43 user nova-compute[71330]:     <tpm supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-tis</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-crb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>passthrough</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>emulator</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </tpm>
Apr 14 11:52:43 user nova-compute[71330]:   </devices>
Apr 14 11:52:43 user nova-compute[71330]:   <features>
Apr 14 11:52:43 user nova-compute[71330]:     <gic supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     <vmcoreinfo supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <genid supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backingStoreInput supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backup supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <sev supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:   </features>
Apr 14 11:52:43 user nova-compute[71330]: </domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:  {{(pid=71330) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 11:52:43 user nova-compute[71330]: <domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 11:52:43 user nova-compute[71330]:   <domain>kvm</domain>
Apr 14 11:52:43 user nova-compute[71330]:   <machine>pc-q35-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:   <arch>i686</arch>
Apr 14 11:52:43 user nova-compute[71330]:   <vcpu max='288'/>
Apr 14 11:52:43 user nova-compute[71330]:   <iothreads supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:   <os supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='firmware'/>
Apr 14 11:52:43 user nova-compute[71330]:     <loader supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>rom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pflash</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='readonly'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='secure'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </loader>
Apr 14 11:52:43 user nova-compute[71330]:   </os>
Apr 14 11:52:43 user nova-compute[71330]:   <cpu>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-passthrough' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='hostPassthroughMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='maximum' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='maximumMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-model' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <vendor>Intel</vendor>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ss'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='vmx'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pcid'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='hypervisor'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arat'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='umip'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='md-clear'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibpb'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibrs'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='erms'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='lm'/>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='custom' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>qemu64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>qemu32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>phenom</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>n270</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>kvm64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>coreduo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>core2duo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>athlon</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Westmere</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Snowridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Penryn</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G5</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G4</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G1</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Nehalem</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Rome</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Milan</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Dhyana</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cooperlake</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Conroe</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>486</model>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:   </cpu>
Apr 14 11:52:43 user nova-compute[71330]:   <memoryBacking supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='sourceType'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>file</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>anonymous</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>memfd</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:   </memoryBacking>
Apr 14 11:52:43 user nova-compute[71330]:   <devices>
Apr 14 11:52:43 user nova-compute[71330]:     <disk supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='diskDevice'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>disk</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cdrom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>floppy</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>lun</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='bus'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>fdc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sata</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </disk>
Apr 14 11:52:43 user nova-compute[71330]:     <graphics supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sdl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vnc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>spice</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egl-headless</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </graphics>
Apr 14 11:52:43 user nova-compute[71330]:     <video supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='modelType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cirrus</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vmvga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>qxl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>none</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>bochs</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ramfb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </video>
Apr 14 11:52:43 user nova-compute[71330]:     <hostdev supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='mode'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>subsystem</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='startupPolicy'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>default</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>mandatory</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>requisite</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>optional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='subsysType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pci</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='capsType'/>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='pciBackend'/>
Apr 14 11:52:43 user nova-compute[71330]:     </hostdev>
Apr 14 11:52:43 user nova-compute[71330]:     <rng supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>random</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egd</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>builtin</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </rng>
Apr 14 11:52:43 user nova-compute[71330]:     <filesystem supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='driverType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>path</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>handle</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtiofs</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </filesystem>
Apr 14 11:52:43 user nova-compute[71330]:     <tpm supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-tis</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-crb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>passthrough</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>emulator</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </tpm>
Apr 14 11:52:43 user nova-compute[71330]:   </devices>
Apr 14 11:52:43 user nova-compute[71330]:   <features>
Apr 14 11:52:43 user nova-compute[71330]:     <gic supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     <vmcoreinfo supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <genid supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backingStoreInput supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backup supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <sev supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:   </features>
Apr 14 11:52:43 user nova-compute[71330]: </domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:  {{(pid=71330) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 11:52:43 user nova-compute[71330]: <domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 11:52:43 user nova-compute[71330]:   <domain>kvm</domain>
Apr 14 11:52:43 user nova-compute[71330]:   <machine>pc-i440fx-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:   <arch>x86_64</arch>
Apr 14 11:52:43 user nova-compute[71330]:   <vcpu max='255'/>
Apr 14 11:52:43 user nova-compute[71330]:   <iothreads supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:   <os supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='firmware'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>efi</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:     <loader supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>rom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pflash</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='readonly'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='secure'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </loader>
Apr 14 11:52:43 user nova-compute[71330]:   </os>
Apr 14 11:52:43 user nova-compute[71330]:   <cpu>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-passthrough' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='hostPassthroughMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='maximum' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='maximumMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-model' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <vendor>Intel</vendor>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ss'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='vmx'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pcid'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='hypervisor'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arat'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='umip'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='md-clear'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='invtsc'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibpb'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibrs'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='rsba'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='erms'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='custom' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>qemu64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>qemu32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>phenom</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>n270</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>coreduo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>core2duo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>athlon</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Westmere</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Snowridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Penryn</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G5</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G4</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Opteron_G1</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Nehalem</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Rome</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Milan</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Dhyana</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cooperlake</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Conroe</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>486</model>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:   </cpu>
Apr 14 11:52:43 user nova-compute[71330]:   <memoryBacking supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='sourceType'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>file</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>anonymous</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>memfd</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:   </memoryBacking>
Apr 14 11:52:43 user nova-compute[71330]:   <devices>
Apr 14 11:52:43 user nova-compute[71330]:     <disk supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='diskDevice'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>disk</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cdrom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>floppy</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>lun</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='bus'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ide</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>fdc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sata</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </disk>
Apr 14 11:52:43 user nova-compute[71330]:     <graphics supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sdl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vnc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>spice</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egl-headless</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </graphics>
Apr 14 11:52:43 user nova-compute[71330]:     <video supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='modelType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cirrus</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vmvga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>qxl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>none</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>bochs</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ramfb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </video>
Apr 14 11:52:43 user nova-compute[71330]:     <hostdev supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='mode'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>subsystem</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='startupPolicy'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>default</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>mandatory</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>requisite</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>optional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='subsysType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pci</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='capsType'/>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='pciBackend'/>
Apr 14 11:52:43 user nova-compute[71330]:     </hostdev>
Apr 14 11:52:43 user nova-compute[71330]:     <rng supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>random</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egd</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>builtin</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </rng>
Apr 14 11:52:43 user nova-compute[71330]:     <filesystem supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='driverType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>path</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>handle</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtiofs</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </filesystem>
Apr 14 11:52:43 user nova-compute[71330]:     <tpm supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-tis</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-crb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>passthrough</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>emulator</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </tpm>
Apr 14 11:52:43 user nova-compute[71330]:   </devices>
Apr 14 11:52:43 user nova-compute[71330]:   <features>
Apr 14 11:52:43 user nova-compute[71330]:     <gic supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     <vmcoreinfo supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <genid supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backingStoreInput supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backup supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <sev supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:   </features>
Apr 14 11:52:43 user nova-compute[71330]: </domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:  {{(pid=71330) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 11:52:43 user nova-compute[71330]: <domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 11:52:43 user nova-compute[71330]:   <domain>kvm</domain>
Apr 14 11:52:43 user nova-compute[71330]:   <machine>pc-q35-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:   <arch>x86_64</arch>
Apr 14 11:52:43 user nova-compute[71330]:   <vcpu max='288'/>
Apr 14 11:52:43 user nova-compute[71330]:   <iothreads supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:   <os supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='firmware'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>efi</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:     <loader supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>rom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pflash</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='readonly'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='secure'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </loader>
Apr 14 11:52:43 user nova-compute[71330]:   </os>
Apr 14 11:52:43 user nova-compute[71330]:   <cpu>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-passthrough' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='hostPassthroughMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='maximum' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='maximumMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-model' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <vendor>Intel</vendor>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ss'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='vmx'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pcid'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='hypervisor'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arat'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='umip'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='md-clear'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='invtsc'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibpb'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibrs'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='rsba'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='erms'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='custom' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>qemu64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>qemu32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>phenom</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>n270</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>coreduo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>core2duo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>athlon</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Westmere</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Snowridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Penryn</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G5</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G4</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Opteron_G1</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Nehalem</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Rome</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Milan</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Dhyana</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cooperlake</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Conroe</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>486</model>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:   </cpu>
Apr 14 11:52:43 user nova-compute[71330]:   <memoryBacking supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='sourceType'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>file</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>anonymous</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>memfd</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:   </memoryBacking>
Apr 14 11:52:43 user nova-compute[71330]:   <devices>
Apr 14 11:52:43 user nova-compute[71330]:     <disk supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='diskDevice'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>disk</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cdrom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>floppy</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>lun</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='bus'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>fdc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sata</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </disk>
Apr 14 11:52:43 user nova-compute[71330]:     <graphics supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sdl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vnc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>spice</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egl-headless</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </graphics>
Apr 14 11:52:43 user nova-compute[71330]:     <video supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='modelType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cirrus</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vmvga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>qxl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>none</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>bochs</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ramfb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </video>
Apr 14 11:52:43 user nova-compute[71330]:     <hostdev supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='mode'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>subsystem</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='startupPolicy'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>default</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>mandatory</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>requisite</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>optional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='subsysType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pci</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='capsType'/>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='pciBackend'/>
Apr 14 11:52:43 user nova-compute[71330]:     </hostdev>
Apr 14 11:52:43 user nova-compute[71330]:     <rng supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>random</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egd</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>builtin</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </rng>
Apr 14 11:52:43 user nova-compute[71330]:     <filesystem supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='driverType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>path</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>handle</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtiofs</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </filesystem>
Apr 14 11:52:43 user nova-compute[71330]:     <tpm supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-tis</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-crb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>passthrough</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>emulator</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </tpm>
Apr 14 11:52:43 user nova-compute[71330]:   </devices>
Apr 14 11:52:43 user nova-compute[71330]:   <features>
Apr 14 11:52:43 user nova-compute[71330]:     <gic supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     <vmcoreinfo supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <genid supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backingStoreInput supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backup supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <sev supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:   </features>
Apr 14 11:52:43 user nova-compute[71330]: </domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:  {{(pid=71330) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 11:52:43 user nova-compute[71330]: <domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 11:52:43 user nova-compute[71330]:   <domain>kvm</domain>
Apr 14 11:52:43 user nova-compute[71330]:   <machine>pc-i440fx-jammy</machine>
Apr 14 11:52:43 user nova-compute[71330]:   <arch>x86_64</arch>
Apr 14 11:52:43 user nova-compute[71330]:   <vcpu max='255'/>
Apr 14 11:52:43 user nova-compute[71330]:   <iothreads supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:   <os supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='firmware'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>efi</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:     <loader supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>rom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pflash</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='readonly'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='secure'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </loader>
Apr 14 11:52:43 user nova-compute[71330]:   </os>
Apr 14 11:52:43 user nova-compute[71330]:   <cpu>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-passthrough' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='hostPassthroughMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='maximum' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='maximumMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-model' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <vendor>Intel</vendor>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ss'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='vmx'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pcid'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='hypervisor'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arat'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='umip'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='md-clear'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='invtsc'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibpb'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibrs'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='rsba'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='erms'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='custom' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>qemu64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>qemu32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>phenom</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>n270</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>coreduo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>core2duo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>athlon</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Westmere</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Snowridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Penryn</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G5</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G4</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Opteron_G1</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Nehalem</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Rome</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Milan</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Dhyana</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cooperlake</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Conroe</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>486</model>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:   </cpu>
Apr 14 11:52:43 user nova-compute[71330]:   <memoryBacking supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='sourceType'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>file</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>anonymous</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>memfd</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:   </memoryBacking>
Apr 14 11:52:43 user nova-compute[71330]:   <devices>
Apr 14 11:52:43 user nova-compute[71330]:     <disk supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='diskDevice'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>disk</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cdrom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>floppy</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>lun</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='bus'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ide</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>fdc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sata</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </disk>
Apr 14 11:52:43 user nova-compute[71330]:     <graphics supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sdl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vnc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>spice</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egl-headless</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </graphics>
Apr 14 11:52:43 user nova-compute[71330]:     <video supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='modelType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cirrus</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vmvga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>qxl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>none</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>bochs</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ramfb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </video>
Apr 14 11:52:43 user nova-compute[71330]:     <hostdev supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='mode'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>subsystem</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='startupPolicy'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>default</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>mandatory</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>requisite</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>optional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='subsysType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pci</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='capsType'/>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='pciBackend'/>
Apr 14 11:52:43 user nova-compute[71330]:     </hostdev>
Apr 14 11:52:43 user nova-compute[71330]:     <rng supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>random</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egd</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>builtin</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </rng>
Apr 14 11:52:43 user nova-compute[71330]:     <filesystem supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='driverType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>path</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>handle</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtiofs</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </filesystem>
Apr 14 11:52:43 user nova-compute[71330]:     <tpm supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-tis</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-crb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>passthrough</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>emulator</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </tpm>
Apr 14 11:52:43 user nova-compute[71330]:   </devices>
Apr 14 11:52:43 user nova-compute[71330]:   <features>
Apr 14 11:52:43 user nova-compute[71330]:     <gic supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     <vmcoreinfo supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <genid supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backingStoreInput supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backup supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <sev supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:   </features>
Apr 14 11:52:43 user nova-compute[71330]: </domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:  {{(pid=71330) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 11:52:43 user nova-compute[71330]: <domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 11:52:43 user nova-compute[71330]:   <domain>kvm</domain>
Apr 14 11:52:43 user nova-compute[71330]:   <machine>pc-q35-6.2</machine>
Apr 14 11:52:43 user nova-compute[71330]:   <arch>x86_64</arch>
Apr 14 11:52:43 user nova-compute[71330]:   <vcpu max='288'/>
Apr 14 11:52:43 user nova-compute[71330]:   <iothreads supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:   <os supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='firmware'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>efi</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:     <loader supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>rom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pflash</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='readonly'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='secure'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>yes</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>no</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </loader>
Apr 14 11:52:43 user nova-compute[71330]:   </os>
Apr 14 11:52:43 user nova-compute[71330]:   <cpu>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-passthrough' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='hostPassthroughMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='maximum' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='maximumMigratable'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>on</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>off</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='host-model' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <vendor>Intel</vendor>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ss'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='vmx'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pcid'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='hypervisor'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arat'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='umip'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='md-clear'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='invtsc'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibpb'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='ibrs'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-stibp'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='rsba'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='erms'/>
Apr 14 11:52:43 user nova-compute[71330]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:     <mode name='custom' supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>qemu64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>qemu32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>phenom</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>pentium</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>n270</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm64</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>kvm32</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>coreduo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>core2duo</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>athlon</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Westmere</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Snowridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Skylake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>SandyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Penryn</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G5</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G4</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G3</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Opteron_G2</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Opteron_G1</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Nehalem</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>IvyBridge</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Icelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Haswell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Rome</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-Milan</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>EPYC</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Dhyana</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cooperlake</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>Conroe</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='no'>Broadwell</model>
Apr 14 11:52:43 user nova-compute[71330]:       <model usable='yes'>486</model>
Apr 14 11:52:43 user nova-compute[71330]:     </mode>
Apr 14 11:52:43 user nova-compute[71330]:   </cpu>
Apr 14 11:52:43 user nova-compute[71330]:   <memoryBacking supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:     <enum name='sourceType'>
Apr 14 11:52:43 user nova-compute[71330]:       <value>file</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>anonymous</value>
Apr 14 11:52:43 user nova-compute[71330]:       <value>memfd</value>
Apr 14 11:52:43 user nova-compute[71330]:     </enum>
Apr 14 11:52:43 user nova-compute[71330]:   </memoryBacking>
Apr 14 11:52:43 user nova-compute[71330]:   <devices>
Apr 14 11:52:43 user nova-compute[71330]:     <disk supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='diskDevice'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>disk</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cdrom</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>floppy</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>lun</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='bus'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>fdc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sata</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </disk>
Apr 14 11:52:43 user nova-compute[71330]:     <graphics supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='type'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>sdl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vnc</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>spice</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egl-headless</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </graphics>
Apr 14 11:52:43 user nova-compute[71330]:     <video supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='modelType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>cirrus</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>vmvga</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>qxl</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>none</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>bochs</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>ramfb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </video>
Apr 14 11:52:43 user nova-compute[71330]:     <hostdev supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='mode'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>subsystem</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='startupPolicy'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>default</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>mandatory</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>requisite</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>optional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='subsysType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>usb</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>pci</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>scsi</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='capsType'/>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='pciBackend'/>
Apr 14 11:52:43 user nova-compute[71330]:     </hostdev>
Apr 14 11:52:43 user nova-compute[71330]:     <rng supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtio-non-transitional</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>random</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>egd</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>builtin</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </rng>
Apr 14 11:52:43 user nova-compute[71330]:     <filesystem supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='driverType'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>path</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>handle</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>virtiofs</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </filesystem>
Apr 14 11:52:43 user nova-compute[71330]:     <tpm supported='yes'>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='model'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-tis</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>tpm-crb</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:       <enum name='backendModel'>
Apr 14 11:52:43 user nova-compute[71330]:         <value>passthrough</value>
Apr 14 11:52:43 user nova-compute[71330]:         <value>emulator</value>
Apr 14 11:52:43 user nova-compute[71330]:       </enum>
Apr 14 11:52:43 user nova-compute[71330]:     </tpm>
Apr 14 11:52:43 user nova-compute[71330]:   </devices>
Apr 14 11:52:43 user nova-compute[71330]:   <features>
Apr 14 11:52:43 user nova-compute[71330]:     <gic supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:     <vmcoreinfo supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <genid supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backingStoreInput supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <backup supported='yes'/>
Apr 14 11:52:43 user nova-compute[71330]:     <sev supported='no'/>
Apr 14 11:52:43 user nova-compute[71330]:   </features>
Apr 14 11:52:43 user nova-compute[71330]: </domainCapabilities>
Apr 14 11:52:43 user nova-compute[71330]:  {{(pid=71330) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71330) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71330) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Checking secure boot support for host arch (x86_64) {{(pid=71330) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Checking secure boot support for host arch (x86_64) {{(pid=71330) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Checking secure boot support for host arch (x86_64) {{(pid=71330) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 11:52:43 user nova-compute[71330]: INFO nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Secure Boot support detected
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] cpu compare xml: <cpu match="exact">
Apr 14 11:52:43 user nova-compute[71330]:   <model>Nehalem</model>
Apr 14 11:52:43 user nova-compute[71330]: </cpu>
Apr 14 11:52:43 user nova-compute[71330]:  {{(pid=71330) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 11:52:43 user nova-compute[71330]: INFO nova.virt.node [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Generated node identity e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0
Apr 14 11:52:43 user nova-compute[71330]: INFO nova.virt.node [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Wrote node identity e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 to /opt/stack/data/nova/compute_id
Apr 14 11:52:43 user nova-compute[71330]: WARNING nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Compute nodes ['e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 11:52:43 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 11:52:43 user nova-compute[71330]: WARNING nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 11:52:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:52:43 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:52:43 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:52:43 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Hypervisor/Node resource view: name=user free_ram=10809MB free_disk=27.154891967773438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:52:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:52:43 user nova-compute[71330]: WARNING nova.compute.resource_tracker [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] No compute node record for user:e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 could not be found.
Apr 14 11:52:43 user nova-compute[71330]: INFO nova.compute.resource_tracker [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Compute node record created for user:user with uuid: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:52:44 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [req-c038c1f3-85eb-4680-9926-bb493bbacea3] Created resource provider record via placement API for resource provider with UUID e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 and name user.
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71330) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 11:52:44 user nova-compute[71330]: INFO nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] kernel doesn't support AMD SEV
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Libvirt baseline CPU <cpu>
Apr 14 11:52:44 user nova-compute[71330]:   <arch>x86_64</arch>
Apr 14 11:52:44 user nova-compute[71330]:   <model>Nehalem</model>
Apr 14 11:52:44 user nova-compute[71330]:   <vendor>Intel</vendor>
Apr 14 11:52:44 user nova-compute[71330]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 11:52:44 user nova-compute[71330]: </cpu>
Apr 14 11:52:44 user nova-compute[71330]:  {{(pid=71330) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Updated inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Updating resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 generation from 0 to 1 during operation: update_inventory {{(pid=71330) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Updating resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 generation from 1 to 2 during operation: update_traits {{(pid=71330) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.service [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Creating RPC server for service compute {{(pid=71330) start /opt/stack/nova/nova/service.py:182}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.service [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Join ServiceGroup membership for this service compute {{(pid=71330) start /opt/stack/nova/nova/service.py:199}}
Apr 14 11:52:44 user nova-compute[71330]: DEBUG nova.servicegroup.drivers.db [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71330) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_power_states {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:53:36 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:53:37 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:53:37 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:53:37 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=10130MB free_disk=27.068614959716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:53:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:53:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:53:37 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:53:37 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:53:37 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:53:37 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:53:37 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:53:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:53:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:54:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:54:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:54:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:54:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:54:36 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:54:36 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:54:36 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:54:36 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=10152MB free_disk=27.114471435546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:54:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:54:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:54:37 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:54:37 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:54:37 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:54:37 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:54:37 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:54:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:55:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:55:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:55:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:55:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:55:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:55:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:55:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:55:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:55:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:55:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:55:38 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:55:38 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:55:38 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:55:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:55:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:55:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:55:38 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:55:38 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:55:38 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:55:38 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=10151MB free_disk=26.890880584716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:55:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:55:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:55:39 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:55:39 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:55:39 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:55:39 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:55:39 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:55:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:35 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:56:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:56:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:56:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:56:38 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:38 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:38 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:38 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:56:38 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:56:38 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:56:38 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=9439MB free_disk=26.914039611816406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:56:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:39 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:56:39 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:56:39 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:56:39 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:56:39 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:56:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:40 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:56:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:53 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:56:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.020s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:53 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:56:53 user nova-compute[71330]: INFO nova.compute.claims [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Claim successful on node user
Apr 14 11:56:54 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG nova.network.neutron [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:56:54 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:56:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:56:54 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Creating image(s)
Apr 14 11:56:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "252824ed-0978-4f05-b03e-4d92057ce3ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.policy [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:56:55 user nova-compute[71330]: INFO nova.compute.claims [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Claim successful on node user
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e.part --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.virt.images [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] a84e226d-f438-4fb3-96fe-51f5960a6c87 was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e.part /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e.part /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e.converted" returned: 0 in 0.158s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.988s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:55 user nova-compute[71330]: INFO oslo.privsep.daemon [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmps8k516j6/privsep.sock']
Apr 14 11:56:55 user sudo[80292]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmps8k516j6/privsep.sock
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:56:55 user sudo[80292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:56:55 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:56:55 user nova-compute[71330]: INFO nova.compute.claims [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Claim successful on node user
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:56:55 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Creating image(s)
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "/opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "/opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "/opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.policy [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31358bf3202e4dcb85df7f64c9d3c1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a8d3457b646fc9085e0aac2cfda5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:56:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:56:56 user nova-compute[71330]: DEBUG nova.network.neutron [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:56:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:56:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:56:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:56:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:56:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Creating image(s)
Apr 14 11:56:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:56 user nova-compute[71330]: DEBUG nova.policy [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:56:57 user sudo[80292]: pam_unix(sudo:session): session closed for user root
Apr 14 11:56:57 user nova-compute[71330]: INFO oslo.privsep.daemon [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Spawned new privsep daemon via rootwrap
Apr 14 11:56:57 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 11:56:57 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 11:56:57 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 11:56:57 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80297
Apr 14 11:56:57 user nova-compute[71330]: WARNING oslo_privsep.priv_context [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] privsep daemon already running
Apr 14 11:56:57 user nova-compute[71330]: WARNING oslo_privsep.priv_context [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] privsep daemon already running
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.174s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk 1073741824" returned: 0 in 0.050s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.164s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.159s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.158s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk 1073741824" returned: 0 in 0.048s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.357s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Cannot resize image /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lazy-loading 'migration_context' on Instance uuid 252824ed-0978-4f05-b03e-4d92057ce3ad {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Ensure instance console log exists: /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.173s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Cannot resize image /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'migration_context' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk 1073741824" returned: 0 in 0.231s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.411s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Ensure instance console log exists: /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.network.neutron [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Successfully created port: e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Cannot resize image /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.objects.instance [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'migration_context' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Ensure instance console log exists: /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Successfully created port: 0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:56:59 user nova-compute[71330]: INFO nova.compute.claims [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Claim successful on node user
Apr 14 11:56:59 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:56:59 user nova-compute[71330]: DEBUG nova.network.neutron [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:56:59 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:56:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:57:00 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Creating image(s)
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG nova.policy [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.127s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk 1073741824" returned: 0 in 0.040s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.124s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Cannot resize image /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG nova.objects.instance [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'migration_context' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Successfully created port: e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Ensure instance console log exists: /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:57:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:01 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:57:01 user nova-compute[71330]: INFO nova.compute.claims [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Claim successful on node user
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Successfully updated port: 0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "refresh_cache-252824ed-0978-4f05-b03e-4d92057ce3ad" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquired lock "refresh_cache-252824ed-0978-4f05-b03e-4d92057ce3ad" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:02 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:57:02 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Creating image(s)
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Successfully updated port: e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquired lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.policy [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b2c1e52acc8496f8f56c82fbce51105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3564d4d9634e469520a3deebe14ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "3a308eef-321e-45c9-bc63-f99c4eacef85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received event network-changed-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Refreshing instance network info cache due to event network-changed-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Acquiring lock "refresh_cache-252824ed-0978-4f05-b03e-4d92057ce3ad" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk 1073741824" returned: 0 in 0.052s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:57:02 user nova-compute[71330]: INFO nova.compute.claims [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Claim successful on node user
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.compute.manager [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-changed-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.compute.manager [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Refreshing instance network info cache due to event network-changed-e6abe9bd-ec11-4204-9e3d-79e395495588. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Acquiring lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Cannot resize image /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.objects.instance [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'migration_context' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Ensure instance console log exists: /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:57:03 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:57:03 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Creating image(s)
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "/opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "/opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk 1073741824" returned: 0 in 0.072s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.policy [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:57:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Cannot resize image /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.objects.instance [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'migration_context' on Instance uuid 3a308eef-321e-45c9-bc63-f99c4eacef85 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Ensure instance console log exists: /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Updating instance_info_cache with network_info: [{"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Releasing lock "refresh_cache-252824ed-0978-4f05-b03e-4d92057ce3ad" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Instance network_info: |[{"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Acquired lock "refresh_cache-252824ed-0978-4f05-b03e-4d92057ce3ad" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.neutron [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Refreshing network info cache for port 0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Start _get_guest_xml network_info=[{"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:04 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:04 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-761931801',display_name='tempest-DeleteServersTestJSON-server-761931801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-761931801',id=2,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='186a8d3457b646fc9085e0aac2cfda5b',ramdisk_id='',reservation_id='r-7ikp1y6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-232033621',owner_user_name='tempest-DeleteServersTestJSON-232033621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:56:56Z,user_data=None,user_id='31358bf3202e4dcb85df7f64c9d3c1d0',uuid=252824ed-0978-4f05-b03e-4d92057ce3ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Converting VIF {"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:56:7f,bridge_name='br-int',has_traffic_filtering=True,id=0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d,network=Network(66d44260-0266-499f-82fb-d7e5bee9fcf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eabf8-1b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lazy-loading 'pci_devices' on Instance uuid 252824ed-0978-4f05-b03e-4d92057ce3ad {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:04 user nova-compute[71330]:   <uuid>252824ed-0978-4f05-b03e-4d92057ce3ad</uuid>
Apr 14 11:57:04 user nova-compute[71330]:   <name>instance-00000002</name>
Apr 14 11:57:04 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:04 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:04 user nova-compute[71330]:   <metadata>
Apr 14 11:57:04 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:04 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:name>tempest-DeleteServersTestJSON-server-761931801</nova:name>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:04</nova:creationTime>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:04 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:04 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:user uuid="31358bf3202e4dcb85df7f64c9d3c1d0">tempest-DeleteServersTestJSON-232033621-project-member</nova:user>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:project uuid="186a8d3457b646fc9085e0aac2cfda5b">tempest-DeleteServersTestJSON-232033621</nova:project>
Apr 14 11:57:04 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:port uuid="0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d">
Apr 14 11:57:04 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 11:57:04 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:04 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:04 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:04 user nova-compute[71330]:   </metadata>
Apr 14 11:57:04 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:04 user nova-compute[71330]:     <system>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="serial">252824ed-0978-4f05-b03e-4d92057ce3ad</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="uuid">252824ed-0978-4f05-b03e-4d92057ce3ad</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:04 user nova-compute[71330]:     </system>
Apr 14 11:57:04 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:04 user nova-compute[71330]:   <os>
Apr 14 11:57:04 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:04 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:04 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:04 user nova-compute[71330]:   </os>
Apr 14 11:57:04 user nova-compute[71330]:   <features>
Apr 14 11:57:04 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:04 user nova-compute[71330]:     <apic/>
Apr 14 11:57:04 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:04 user nova-compute[71330]:   </features>
Apr 14 11:57:04 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:04 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:04 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:04 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:04 user nova-compute[71330]:   </clock>
Apr 14 11:57:04 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:04 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:04 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:04 user nova-compute[71330]:   </cpu>
Apr 14 11:57:04 user nova-compute[71330]:   <devices>
Apr 14 11:57:04 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:04 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:04 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk"/>
Apr 14 11:57:04 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:57:04 user nova-compute[71330]:     </disk>
Apr 14 11:57:04 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:04 user nova-compute[71330]:       <mac address="fa:16:3e:5b:56:7f"/>
Apr 14 11:57:04 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:04 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:04 user nova-compute[71330]:       <target dev="tap0e9eabf8-1b"/>
Apr 14 11:57:04 user nova-compute[71330]:     </interface>
Apr 14 11:57:04 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:04 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/console.log" append="off"/>
Apr 14 11:57:04 user nova-compute[71330]:     </serial>
Apr 14 11:57:04 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:04 user nova-compute[71330]:     <video>
Apr 14 11:57:04 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:04 user nova-compute[71330]:     </video>
Apr 14 11:57:04 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:04 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:04 user nova-compute[71330]:     </rng>
Apr 14 11:57:04 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:04 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:04 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:04 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:04 user nova-compute[71330]:   </devices>
Apr 14 11:57:04 user nova-compute[71330]: </domain>
Apr 14 11:57:04 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-761931801',display_name='tempest-DeleteServersTestJSON-server-761931801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-761931801',id=2,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='186a8d3457b646fc9085e0aac2cfda5b',ramdisk_id='',reservation_id='r-7ikp1y6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-232033621',owner_user_name='tempest-DeleteServersTestJSON-232033621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:56:56Z,user_data=None,user_id='31358bf3202e4dcb85df7f64c9d3c1d0',uuid=252824ed-0978-4f05-b03e-4d92057ce3ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Converting VIF {"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:56:7f,bridge_name='br-int',has_traffic_filtering=True,id=0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d,network=Network(66d44260-0266-499f-82fb-d7e5bee9fcf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eabf8-1b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG os_vif [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:56:7f,bridge_name='br-int',has_traffic_filtering=True,id=0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d,network=Network(66d44260-0266-499f-82fb-d7e5bee9fcf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eabf8-1b') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Created schema index Interface.name {{(pid=71330) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Created schema index Port.name {{(pid=71330) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Created schema index Bridge.name {{(pid=71330) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [POLLOUT] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:04 user nova-compute[71330]: INFO oslo.privsep.daemon [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpjru8053d/privsep.sock']
Apr 14 11:57:04 user sudo[80396]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpjru8053d/privsep.sock
Apr 14 11:57:04 user sudo[80396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updating instance_info_cache with network_info: [{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Releasing lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Instance network_info: |[{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Acquired lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.neutron [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Refreshing network info cache for port e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Start _get_guest_xml network_info=[{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:04 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:04 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621276567',display_name='tempest-ServerRescueNegativeTestJSON-server-1621276567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621276567',id=1,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-x60bo87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:56:54Z,user_data=None,user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=16a25a1d-bc8b-4de0-b975-037aee0d46ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:f5:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6abe9bd-ec11-4204-9e3d-79e395495588,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6abe9bd-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'pci_devices' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:04 user nova-compute[71330]:   <uuid>16a25a1d-bc8b-4de0-b975-037aee0d46ee</uuid>
Apr 14 11:57:04 user nova-compute[71330]:   <name>instance-00000001</name>
Apr 14 11:57:04 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:04 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:04 user nova-compute[71330]:   <metadata>
Apr 14 11:57:04 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:04 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1621276567</nova:name>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:04</nova:creationTime>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:04 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:04 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:user uuid="263c47076ee94cfaaa34eff928a36fdd">tempest-ServerRescueNegativeTestJSON-896417797-project-member</nova:user>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:project uuid="f042abdcef8f41488e8f4624c2f4970b">tempest-ServerRescueNegativeTestJSON-896417797</nova:project>
Apr 14 11:57:04 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:57:04 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:04 user nova-compute[71330]:         <nova:port uuid="e6abe9bd-ec11-4204-9e3d-79e395495588">
Apr 14 11:57:04 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 11:57:04 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:04 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:04 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:04 user nova-compute[71330]:   </metadata>
Apr 14 11:57:04 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:04 user nova-compute[71330]:     <system>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="serial">16a25a1d-bc8b-4de0-b975-037aee0d46ee</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="uuid">16a25a1d-bc8b-4de0-b975-037aee0d46ee</entry>
Apr 14 11:57:04 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:04 user nova-compute[71330]:     </system>
Apr 14 11:57:04 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:04 user nova-compute[71330]:   <os>
Apr 14 11:57:04 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:04 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:04 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:04 user nova-compute[71330]:   </os>
Apr 14 11:57:04 user nova-compute[71330]:   <features>
Apr 14 11:57:04 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:04 user nova-compute[71330]:     <apic/>
Apr 14 11:57:04 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:04 user nova-compute[71330]:   </features>
Apr 14 11:57:04 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:04 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:04 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:04 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:04 user nova-compute[71330]:   </clock>
Apr 14 11:57:04 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:04 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:04 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:04 user nova-compute[71330]:   </cpu>
Apr 14 11:57:04 user nova-compute[71330]:   <devices>
Apr 14 11:57:04 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:04 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:04 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk"/>
Apr 14 11:57:04 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:57:04 user nova-compute[71330]:     </disk>
Apr 14 11:57:04 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:04 user nova-compute[71330]:       <mac address="fa:16:3e:66:f5:bb"/>
Apr 14 11:57:04 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:04 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:04 user nova-compute[71330]:       <target dev="tape6abe9bd-ec"/>
Apr 14 11:57:04 user nova-compute[71330]:     </interface>
Apr 14 11:57:04 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:04 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/console.log" append="off"/>
Apr 14 11:57:04 user nova-compute[71330]:     </serial>
Apr 14 11:57:04 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:04 user nova-compute[71330]:     <video>
Apr 14 11:57:04 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:04 user nova-compute[71330]:     </video>
Apr 14 11:57:04 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:04 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:04 user nova-compute[71330]:     </rng>
Apr 14 11:57:04 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:04 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:04 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:04 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:04 user nova-compute[71330]:   </devices>
Apr 14 11:57:04 user nova-compute[71330]: </domain>
Apr 14 11:57:04 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621276567',display_name='tempest-ServerRescueNegativeTestJSON-server-1621276567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621276567',id=1,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-x60bo87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:56:54Z,user_data=None,user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=16a25a1d-bc8b-4de0-b975-037aee0d46ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:f5:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6abe9bd-ec11-4204-9e3d-79e395495588,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6abe9bd-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG os_vif [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:f5:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6abe9bd-ec11-4204-9e3d-79e395495588,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6abe9bd-ec') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Successfully created port: 00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Successfully created port: 7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Successfully updated port: 00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquired lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-changed-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Refreshing instance network info cache due to event network-changed-00a245fe-c22c-48a0-9718-72e81d0ef026. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Acquiring lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Successfully updated port: e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquired lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating instance_info_cache with network_info: [{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Releasing lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Instance network_info: |[{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-changed-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Refreshing instance network info cache due to event network-changed-e5175890-c267-454b-b532-70223beb1f72. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] Acquiring lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Acquired lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Refreshing network info cache for port 00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Start _get_guest_xml network_info=[{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:06 user sudo[80396]: pam_unix(sudo:session): session closed for user root
Apr 14 11:57:06 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:06 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1793780522',display_name='tempest-ServerStableDeviceRescueTest-server-1793780522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1793780522',id=5,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXuDQX5mdlneSOlaQfy+4JxDU0auroTMJCiqenRoOw2yfCd/60N23lq489zSoPdy+CApif7xFXMGBg0JnCYtsNCRaca1mNN0lFB5bW9+TQVJK0zLh1rtz82y9q/SaEasg==',key_name='tempest-keypair-438477400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b3564d4d9634e469520a3deebe14ab6',ramdisk_id='',reservation_id='r-p9k52wkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1361865083',owner_user_name='tempest-ServerStableDeviceRescueTest-1361865083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2c1e52acc8496f8f56c82fbce51105',uuid=80b9c47d-7dc8-4bbe-b961-41921a457d98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Converting VIF {"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fb:9f,bridge_name='br-int',has_traffic_filtering=True,id=00a245fe-c22c-48a0-9718-72e81d0ef026,network=Network(f01a9b31-3529-47ab-bd37-1b80abdf9e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a245fe-c2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.objects.instance [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'pci_devices' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:06 user nova-compute[71330]: INFO oslo.privsep.daemon [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Spawned new privsep daemon via rootwrap
Apr 14 11:57:06 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 11:57:06 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 11:57:06 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 11:57:06 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80401
Apr 14 11:57:06 user nova-compute[71330]: WARNING oslo_privsep.priv_context [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] privsep daemon already running
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:06 user nova-compute[71330]:   <uuid>80b9c47d-7dc8-4bbe-b961-41921a457d98</uuid>
Apr 14 11:57:06 user nova-compute[71330]:   <name>instance-00000005</name>
Apr 14 11:57:06 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:06 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:06 user nova-compute[71330]:   <metadata>
Apr 14 11:57:06 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:06 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:06 user nova-compute[71330]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1793780522</nova:name>
Apr 14 11:57:06 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:06</nova:creationTime>
Apr 14 11:57:06 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:06 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:06 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:06 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:06 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:06 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:06 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:06 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:06 user nova-compute[71330]:         <nova:user uuid="6b2c1e52acc8496f8f56c82fbce51105">tempest-ServerStableDeviceRescueTest-1361865083-project-member</nova:user>
Apr 14 11:57:06 user nova-compute[71330]:         <nova:project uuid="1b3564d4d9634e469520a3deebe14ab6">tempest-ServerStableDeviceRescueTest-1361865083</nova:project>
Apr 14 11:57:06 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:06 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:57:06 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:06 user nova-compute[71330]:         <nova:port uuid="00a245fe-c22c-48a0-9718-72e81d0ef026">
Apr 14 11:57:06 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 11:57:06 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:06 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:06 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:06 user nova-compute[71330]:   </metadata>
Apr 14 11:57:06 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:06 user nova-compute[71330]:     <system>
Apr 14 11:57:06 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:06 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:06 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:06 user nova-compute[71330]:       <entry name="serial">80b9c47d-7dc8-4bbe-b961-41921a457d98</entry>
Apr 14 11:57:06 user nova-compute[71330]:       <entry name="uuid">80b9c47d-7dc8-4bbe-b961-41921a457d98</entry>
Apr 14 11:57:06 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:06 user nova-compute[71330]:     </system>
Apr 14 11:57:06 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:06 user nova-compute[71330]:   <os>
Apr 14 11:57:06 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:06 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:06 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:06 user nova-compute[71330]:   </os>
Apr 14 11:57:06 user nova-compute[71330]:   <features>
Apr 14 11:57:06 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:06 user nova-compute[71330]:     <apic/>
Apr 14 11:57:06 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:06 user nova-compute[71330]:   </features>
Apr 14 11:57:06 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:06 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:06 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:06 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:06 user nova-compute[71330]:   </clock>
Apr 14 11:57:06 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:06 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:06 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:06 user nova-compute[71330]:   </cpu>
Apr 14 11:57:06 user nova-compute[71330]:   <devices>
Apr 14 11:57:06 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:06 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:06 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk"/>
Apr 14 11:57:06 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:57:06 user nova-compute[71330]:     </disk>
Apr 14 11:57:06 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:06 user nova-compute[71330]:       <mac address="fa:16:3e:b7:fb:9f"/>
Apr 14 11:57:06 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:06 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:06 user nova-compute[71330]:       <target dev="tap00a245fe-c2"/>
Apr 14 11:57:06 user nova-compute[71330]:     </interface>
Apr 14 11:57:06 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:06 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/console.log" append="off"/>
Apr 14 11:57:06 user nova-compute[71330]:     </serial>
Apr 14 11:57:06 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:06 user nova-compute[71330]:     <video>
Apr 14 11:57:06 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:06 user nova-compute[71330]:     </video>
Apr 14 11:57:06 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:06 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:06 user nova-compute[71330]:     </rng>
Apr 14 11:57:06 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:06 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:06 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:06 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:06 user nova-compute[71330]:   </devices>
Apr 14 11:57:06 user nova-compute[71330]: </domain>
Apr 14 11:57:06 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1793780522',display_name='tempest-ServerStableDeviceRescueTest-server-1793780522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1793780522',id=5,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXuDQX5mdlneSOlaQfy+4JxDU0auroTMJCiqenRoOw2yfCd/60N23lq489zSoPdy+CApif7xFXMGBg0JnCYtsNCRaca1mNN0lFB5bW9+TQVJK0zLh1rtz82y9q/SaEasg==',key_name='tempest-keypair-438477400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b3564d4d9634e469520a3deebe14ab6',ramdisk_id='',reservation_id='r-p9k52wkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1361865083',owner_user_name='tempest-ServerStableDeviceRescueTest-1361865083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2c1e52acc8496f8f56c82fbce51105',uuid=80b9c47d-7dc8-4bbe-b961-41921a457d98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Converting VIF {"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fb:9f,bridge_name='br-int',has_traffic_filtering=True,id=00a245fe-c22c-48a0-9718-72e81d0ef026,network=Network(f01a9b31-3529-47ab-bd37-1b80abdf9e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a245fe-c2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG os_vif [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fb:9f,bridge_name='br-int',has_traffic_filtering=True,id=00a245fe-c22c-48a0-9718-72e81d0ef026,network=Network(f01a9b31-3529-47ab-bd37-1b80abdf9e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a245fe-c2') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Updated VIF entry in instance network info cache for port 0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Updating instance_info_cache with network_info: [{"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Releasing lock "refresh_cache-252824ed-0978-4f05-b03e-4d92057ce3ad" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updated VIF entry in instance network info cache for port e6abe9bd-ec11-4204-9e3d-79e395495588. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updating instance_info_cache with network_info: [{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Releasing lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6abe9bd-ec, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6abe9bd-ec, col_values=(('external_ids', {'iface-id': 'e6abe9bd-ec11-4204-9e3d-79e395495588', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:f5:bb', 'vm-uuid': '16a25a1d-bc8b-4de0-b975-037aee0d46ee'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: INFO os_vif [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:f5:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6abe9bd-ec11-4204-9e3d-79e395495588,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6abe9bd-ec')
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e9eabf8-1b, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e9eabf8-1b, col_values=(('external_ids', {'iface-id': '0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:56:7f', 'vm-uuid': '252824ed-0978-4f05-b03e-4d92057ce3ad'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: INFO os_vif [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:56:7f,bridge_name='br-int',has_traffic_filtering=True,id=0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d,network=Network(66d44260-0266-499f-82fb-d7e5bee9fcf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eabf8-1b')
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00a245fe-c2, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00a245fe-c2, col_values=(('external_ids', {'iface-id': '00a245fe-c22c-48a0-9718-72e81d0ef026', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:fb:9f', 'vm-uuid': '80b9c47d-7dc8-4bbe-b961-41921a457d98'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:06 user nova-compute[71330]: INFO os_vif [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fb:9f,bridge_name='br-int',has_traffic_filtering=True,id=00a245fe-c22c-48a0-9718-72e81d0ef026,network=Network(f01a9b31-3529-47ab-bd37-1b80abdf9e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a245fe-c2')
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No VIF found with MAC fa:16:3e:66:f5:bb, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] No VIF found with MAC fa:16:3e:5b:56:7f, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] No VIF found with MAC fa:16:3e:b7:fb:9f, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Successfully created port: b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updated VIF entry in instance network info cache for port 00a245fe-c22c-48a0-9718-72e81d0ef026. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating instance_info_cache with network_info: [{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Releasing lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:07 user nova-compute[71330]: DEBUG nova.network.neutron [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Successfully updated port: 7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquired lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:07 user nova-compute[71330]: DEBUG nova.network.neutron [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-changed-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Refreshing instance network info cache due to event network-changed-7ea071f4-a31f-4eb6-b79b-971106d2c33e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] Acquiring lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:07 user nova-compute[71330]: DEBUG nova.network.neutron [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.neutron [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updating instance_info_cache with network_info: [{"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Releasing lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Instance network_info: |[{"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] Acquired lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.neutron [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Refreshing network info cache for port e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Start _get_guest_xml network_info=[{"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1361327346',display_name='tempest-ServerRescueNegativeTestJSON-server-1361327346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1361327346',id=3,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-30rb8yo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:56:56Z,user_data=None,user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=68f7b119-b1c9-47ce-b325-5a4730aef707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:90:02,bridge_name='br-int',has_traffic_filtering=True,id=e5175890-c267-454b-b532-70223beb1f72,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5175890-c2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.objects.instance [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'pci_devices' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:08 user nova-compute[71330]:   <uuid>68f7b119-b1c9-47ce-b325-5a4730aef707</uuid>
Apr 14 11:57:08 user nova-compute[71330]:   <name>instance-00000003</name>
Apr 14 11:57:08 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:08 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:08 user nova-compute[71330]:   <metadata>
Apr 14 11:57:08 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:08 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1361327346</nova:name>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:08</nova:creationTime>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:08 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:08 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:user uuid="263c47076ee94cfaaa34eff928a36fdd">tempest-ServerRescueNegativeTestJSON-896417797-project-member</nova:user>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:project uuid="f042abdcef8f41488e8f4624c2f4970b">tempest-ServerRescueNegativeTestJSON-896417797</nova:project>
Apr 14 11:57:08 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:port uuid="e5175890-c267-454b-b532-70223beb1f72">
Apr 14 11:57:08 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 11:57:08 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:08 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:08 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:08 user nova-compute[71330]:   </metadata>
Apr 14 11:57:08 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:08 user nova-compute[71330]:     <system>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="serial">68f7b119-b1c9-47ce-b325-5a4730aef707</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="uuid">68f7b119-b1c9-47ce-b325-5a4730aef707</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:08 user nova-compute[71330]:     </system>
Apr 14 11:57:08 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:08 user nova-compute[71330]:   <os>
Apr 14 11:57:08 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:08 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:08 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:08 user nova-compute[71330]:   </os>
Apr 14 11:57:08 user nova-compute[71330]:   <features>
Apr 14 11:57:08 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:08 user nova-compute[71330]:     <apic/>
Apr 14 11:57:08 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:08 user nova-compute[71330]:   </features>
Apr 14 11:57:08 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:08 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:08 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:08 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:08 user nova-compute[71330]:   </clock>
Apr 14 11:57:08 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:08 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:08 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:08 user nova-compute[71330]:   </cpu>
Apr 14 11:57:08 user nova-compute[71330]:   <devices>
Apr 14 11:57:08 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:08 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:08 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk"/>
Apr 14 11:57:08 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:57:08 user nova-compute[71330]:     </disk>
Apr 14 11:57:08 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:08 user nova-compute[71330]:       <mac address="fa:16:3e:66:90:02"/>
Apr 14 11:57:08 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:08 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:08 user nova-compute[71330]:       <target dev="tape5175890-c2"/>
Apr 14 11:57:08 user nova-compute[71330]:     </interface>
Apr 14 11:57:08 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:08 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/console.log" append="off"/>
Apr 14 11:57:08 user nova-compute[71330]:     </serial>
Apr 14 11:57:08 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:08 user nova-compute[71330]:     <video>
Apr 14 11:57:08 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:08 user nova-compute[71330]:     </video>
Apr 14 11:57:08 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:08 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:08 user nova-compute[71330]:     </rng>
Apr 14 11:57:08 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:08 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:08 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:08 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:08 user nova-compute[71330]:   </devices>
Apr 14 11:57:08 user nova-compute[71330]: </domain>
Apr 14 11:57:08 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1361327346',display_name='tempest-ServerRescueNegativeTestJSON-server-1361327346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1361327346',id=3,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-30rb8yo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:56:56Z,user_data=None,user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=68f7b119-b1c9-47ce-b325-5a4730aef707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:90:02,bridge_name='br-int',has_traffic_filtering=True,id=e5175890-c267-454b-b532-70223beb1f72,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5175890-c2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG os_vif [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:90:02,bridge_name='br-int',has_traffic_filtering=True,id=e5175890-c267-454b-b532-70223beb1f72,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5175890-c2') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5175890-c2, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5175890-c2, col_values=(('external_ids', {'iface-id': 'e5175890-c267-454b-b532-70223beb1f72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:90:02', 'vm-uuid': '68f7b119-b1c9-47ce-b325-5a4730aef707'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: INFO os_vif [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:90:02,bridge_name='br-int',has_traffic_filtering=True,id=e5175890-c267-454b-b532-70223beb1f72,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5175890-c2')
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No VIF found with MAC fa:16:3e:66:90:02, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.neutron [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating instance_info_cache with network_info: [{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Releasing lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance network_info: |[{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] Acquired lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.neutron [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Refreshing network info cache for port 7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Start _get_guest_xml network_info=[{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373523786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373523786',id=4,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsyIPWrTgYx5mDYmYLAUYql9c5ytzflRJOI8xt+Liz9SO5uhpL9//IuWHW3+gSIh0I3JxFjHbVn4FDFn00auhiTq2XJaAhJLeaQLZujkXhytUWDHfKLlHryI1f/amUc4g==',key_name='tempest-keypair-1689899826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-fmqjkid5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=ad7c2f89-c54f-4e78-b86d-88b4ab5daff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.objects.instance [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'pci_devices' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:08 user nova-compute[71330]:   <uuid>ad7c2f89-c54f-4e78-b86d-88b4ab5daff4</uuid>
Apr 14 11:57:08 user nova-compute[71330]:   <name>instance-00000004</name>
Apr 14 11:57:08 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:08 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:08 user nova-compute[71330]:   <metadata>
Apr 14 11:57:08 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:08 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1373523786</nova:name>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:08</nova:creationTime>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:08 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:08 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:user uuid="260d1d4ef5a1422f84f9d91224b53952">tempest-AttachVolumeShelveTestJSON-1457966394-project-member</nova:user>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:project uuid="cc13fb093d2745e8ba0152533140b6f2">tempest-AttachVolumeShelveTestJSON-1457966394</nova:project>
Apr 14 11:57:08 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:57:08 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:08 user nova-compute[71330]:         <nova:port uuid="7ea071f4-a31f-4eb6-b79b-971106d2c33e">
Apr 14 11:57:08 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 11:57:08 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:08 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:08 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:08 user nova-compute[71330]:   </metadata>
Apr 14 11:57:08 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:08 user nova-compute[71330]:     <system>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="serial">ad7c2f89-c54f-4e78-b86d-88b4ab5daff4</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="uuid">ad7c2f89-c54f-4e78-b86d-88b4ab5daff4</entry>
Apr 14 11:57:08 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:08 user nova-compute[71330]:     </system>
Apr 14 11:57:08 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:08 user nova-compute[71330]:   <os>
Apr 14 11:57:08 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:08 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:08 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:08 user nova-compute[71330]:   </os>
Apr 14 11:57:08 user nova-compute[71330]:   <features>
Apr 14 11:57:08 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:08 user nova-compute[71330]:     <apic/>
Apr 14 11:57:08 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:08 user nova-compute[71330]:   </features>
Apr 14 11:57:08 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:08 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:08 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:08 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:08 user nova-compute[71330]:   </clock>
Apr 14 11:57:08 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:08 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:08 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:08 user nova-compute[71330]:   </cpu>
Apr 14 11:57:08 user nova-compute[71330]:   <devices>
Apr 14 11:57:08 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:08 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:08 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk"/>
Apr 14 11:57:08 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:57:08 user nova-compute[71330]:     </disk>
Apr 14 11:57:08 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:08 user nova-compute[71330]:       <mac address="fa:16:3e:19:43:63"/>
Apr 14 11:57:08 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:08 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:08 user nova-compute[71330]:       <target dev="tap7ea071f4-a3"/>
Apr 14 11:57:08 user nova-compute[71330]:     </interface>
Apr 14 11:57:08 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:08 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/console.log" append="off"/>
Apr 14 11:57:08 user nova-compute[71330]:     </serial>
Apr 14 11:57:08 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:08 user nova-compute[71330]:     <video>
Apr 14 11:57:08 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:08 user nova-compute[71330]:     </video>
Apr 14 11:57:08 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:08 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:08 user nova-compute[71330]:     </rng>
Apr 14 11:57:08 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:08 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:08 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:08 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:08 user nova-compute[71330]:   </devices>
Apr 14 11:57:08 user nova-compute[71330]: </domain>
Apr 14 11:57:08 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373523786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373523786',id=4,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsyIPWrTgYx5mDYmYLAUYql9c5ytzflRJOI8xt+Liz9SO5uhpL9//IuWHW3+gSIh0I3JxFjHbVn4FDFn00auhiTq2XJaAhJLeaQLZujkXhytUWDHfKLlHryI1f/amUc4g==',key_name='tempest-keypair-1689899826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-fmqjkid5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=ad7c2f89-c54f-4e78-b86d-88b4ab5daff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG os_vif [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ea071f4-a3, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ea071f4-a3, col_values=(('external_ids', {'iface-id': '7ea071f4-a31f-4eb6-b79b-971106d2c33e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:43:63', 'vm-uuid': 'ad7c2f89-c54f-4e78-b86d-88b4ab5daff4'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:08 user nova-compute[71330]: INFO os_vif [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3')
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] No VIF found with MAC fa:16:3e:19:43:63, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:09 user nova-compute[71330]: DEBUG nova.network.neutron [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Successfully updated port: b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquired lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:09 user nova-compute[71330]: DEBUG nova.network.neutron [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:09 user nova-compute[71330]: DEBUG nova.network.neutron [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received event network-changed-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Refreshing instance network info cache due to event network-changed-b417bb86-4450-4242-b710-0a5dd06d6777. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] Acquiring lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updated VIF entry in instance network info cache for port 7ea071f4-a31f-4eb6-b79b-971106d2c33e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating instance_info_cache with network_info: [{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] Releasing lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG nova.network.neutron [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updating instance_info_cache with network_info: [{"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Releasing lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Instance network_info: |[{"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] Acquired lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Refreshing network info cache for port b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Start _get_guest_xml network_info=[{"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updated VIF entry in instance network info cache for port e5175890-c267-454b-b532-70223beb1f72. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updating instance_info_cache with network_info: [{"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] Releasing lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:11 user nova-compute[71330]: DEBUG nova.network.neutron [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updated VIF entry in instance network info cache for port b417bb86-4450-4242-b710-0a5dd06d6777. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:11 user nova-compute[71330]: DEBUG nova.network.neutron [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updating instance_info_cache with network_info: [{"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] Releasing lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:12 user nova-compute[71330]: WARNING nova.compute.manager [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state building and task_state spawning.
Apr 14 11:57:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received event network-vif-plugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] Acquiring lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] No waiting events found dispatching network-vif-plugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:13 user nova-compute[71330]: WARNING nova.compute.manager [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received unexpected event network-vif-plugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance with vm_state building and task_state spawning.
Apr 14 11:57:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] No waiting events found dispatching network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:13 user nova-compute[71330]: WARNING nova.compute.manager [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received unexpected event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance with vm_state building and task_state spawning.
Apr 14 11:57:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:14 user nova-compute[71330]: WARNING nova.compute.manager [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state building and task_state spawning.
Apr 14 11:57:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:14 user nova-compute[71330]: WARNING nova.compute.manager [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state building and task_state spawning.
Apr 14 11:57:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received event network-vif-plugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] Acquiring lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] No waiting events found dispatching network-vif-plugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:15 user nova-compute[71330]: WARNING nova.compute.manager [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received unexpected event network-vif-plugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance with vm_state building and task_state spawning.
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] No waiting events found dispatching network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:15 user nova-compute[71330]: WARNING nova.compute.manager [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received unexpected event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance with vm_state building and task_state spawning.
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473435.7356145, 16a25a1d-bc8b-4de0-b975-037aee0d46ee => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:15 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] VM Resumed (Lifecycle Event)
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:15 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Instance spawned successfully.
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:15 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:15 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441296803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441296803',id=6,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-lnhdenbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:03Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=3a308eef-321e-45c9-bc63-f99c4eacef85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b417bb86-4450-4242-b710-0a5dd06d6777,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb417bb86-44') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.objects.instance [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a308eef-321e-45c9-bc63-f99c4eacef85 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:15 user nova-compute[71330]:   <uuid>3a308eef-321e-45c9-bc63-f99c4eacef85</uuid>
Apr 14 11:57:15 user nova-compute[71330]:   <name>instance-00000006</name>
Apr 14 11:57:15 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:15 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:15 user nova-compute[71330]:   <metadata>
Apr 14 11:57:15 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:15 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:15 user nova-compute[71330]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-441296803</nova:name>
Apr 14 11:57:15 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:15</nova:creationTime>
Apr 14 11:57:15 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:15 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:15 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:15 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:15 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:15 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:15 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:15 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:15 user nova-compute[71330]:         <nova:user uuid="11df88c60e4b456691d8731fe8facf38">tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member</nova:user>
Apr 14 11:57:15 user nova-compute[71330]:         <nova:project uuid="2c5140d4419e43be941c2ac5d5439e35">tempest-ServerBootFromVolumeStableRescueTest-1565599676</nova:project>
Apr 14 11:57:15 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:15 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:57:15 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:15 user nova-compute[71330]:         <nova:port uuid="b417bb86-4450-4242-b710-0a5dd06d6777">
Apr 14 11:57:15 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 11:57:15 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:15 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:15 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:15 user nova-compute[71330]:   </metadata>
Apr 14 11:57:15 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:15 user nova-compute[71330]:     <system>
Apr 14 11:57:15 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:15 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:15 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:15 user nova-compute[71330]:       <entry name="serial">3a308eef-321e-45c9-bc63-f99c4eacef85</entry>
Apr 14 11:57:15 user nova-compute[71330]:       <entry name="uuid">3a308eef-321e-45c9-bc63-f99c4eacef85</entry>
Apr 14 11:57:15 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:15 user nova-compute[71330]:     </system>
Apr 14 11:57:15 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:15 user nova-compute[71330]:   <os>
Apr 14 11:57:15 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:15 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:15 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:15 user nova-compute[71330]:   </os>
Apr 14 11:57:15 user nova-compute[71330]:   <features>
Apr 14 11:57:15 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:15 user nova-compute[71330]:     <apic/>
Apr 14 11:57:15 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:15 user nova-compute[71330]:   </features>
Apr 14 11:57:15 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:15 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:15 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:15 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:15 user nova-compute[71330]:   </clock>
Apr 14 11:57:15 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:15 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:15 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:15 user nova-compute[71330]:   </cpu>
Apr 14 11:57:15 user nova-compute[71330]:   <devices>
Apr 14 11:57:15 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:15 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:15 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk"/>
Apr 14 11:57:15 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:57:15 user nova-compute[71330]:     </disk>
Apr 14 11:57:15 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:15 user nova-compute[71330]:       <mac address="fa:16:3e:17:a7:39"/>
Apr 14 11:57:15 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:15 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:15 user nova-compute[71330]:       <target dev="tapb417bb86-44"/>
Apr 14 11:57:15 user nova-compute[71330]:     </interface>
Apr 14 11:57:15 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:15 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/console.log" append="off"/>
Apr 14 11:57:15 user nova-compute[71330]:     </serial>
Apr 14 11:57:15 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:15 user nova-compute[71330]:     <video>
Apr 14 11:57:15 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:15 user nova-compute[71330]:     </video>
Apr 14 11:57:15 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:15 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:15 user nova-compute[71330]:     </rng>
Apr 14 11:57:15 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:15 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:15 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:15 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:15 user nova-compute[71330]:   </devices>
Apr 14 11:57:15 user nova-compute[71330]: </domain>
Apr 14 11:57:15 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441296803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441296803',id=6,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-lnhdenbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:03Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=3a308eef-321e-45c9-bc63-f99c4eacef85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b417bb86-4450-4242-b710-0a5dd06d6777,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb417bb86-44') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG os_vif [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b417bb86-4450-4242-b710-0a5dd06d6777,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb417bb86-44') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb417bb86-44, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb417bb86-44, col_values=(('external_ids', {'iface-id': 'b417bb86-4450-4242-b710-0a5dd06d6777', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:a7:39', 'vm-uuid': '3a308eef-321e-45c9-bc63-f99c4eacef85'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:15 user nova-compute[71330]: INFO os_vif [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b417bb86-4450-4242-b710-0a5dd06d6777,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb417bb86-44')
Apr 14 11:57:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No VIF found with MAC fa:16:3e:17:a7:39, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:16 user nova-compute[71330]: INFO nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Took 21.52 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:16 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473435.743128, 16a25a1d-bc8b-4de0-b975-037aee0d46ee => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:16 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] VM Started (Lifecycle Event)
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:16 user nova-compute[71330]: WARNING nova.compute.manager [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state building and task_state spawning.
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:16 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Instance spawned successfully.
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:16 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473436.863517, 68f7b119-b1c9-47ce-b325-5a4730aef707 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:16 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] VM Resumed (Lifecycle Event)
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Took 23.52 seconds to build instance.
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473436.8638854, 68f7b119-b1c9-47ce-b325-5a4730aef707 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] VM Started (Lifecycle Event)
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Instance spawned successfully.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Took 20.96 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.813s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473437.16405, 252824ed-0978-4f05-b03e-4d92057ce3ad => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] VM Resumed (Lifecycle Event)
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance spawned successfully.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Instance spawned successfully.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Took 21.63 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473437.1664274, 252824ed-0978-4f05-b03e-4d92057ce3ad => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] VM Started (Lifecycle Event)
Apr 14 11:57:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Took 22.04 seconds to build instance.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473437.3468993, ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] VM Resumed (Lifecycle Event)
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] No waiting events found dispatching network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:17 user nova-compute[71330]: WARNING nova.compute.manager [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received unexpected event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 for instance with vm_state active and task_state None.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] No waiting events found dispatching network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:17 user nova-compute[71330]: WARNING nova.compute.manager [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received unexpected event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 for instance with vm_state active and task_state None.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.374s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:17 user nova-compute[71330]: INFO nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Took 17.89 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:18 user nova-compute[71330]: INFO nova.compute.manager [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Took 22.95 seconds to build instance.
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:18 user nova-compute[71330]: INFO nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Took 15.66 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.344s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473437.3469996, ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] VM Started (Lifecycle Event)
Apr 14 11:57:18 user nova-compute[71330]: INFO nova.compute.manager [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Took 18.80 seconds to build instance.
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:18 user nova-compute[71330]: INFO nova.compute.manager [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Took 16.51 seconds to build instance.
Apr 14 11:57:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.984s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.635s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473437.3659997, 80b9c47d-7dc8-4bbe-b961-41921a457d98 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] VM Resumed (Lifecycle Event)
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473437.3721383, 80b9c47d-7dc8-4bbe-b961-41921a457d98 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] VM Started (Lifecycle Event)
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received event network-vif-plugged-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] Acquiring lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] No waiting events found dispatching network-vif-plugged-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:18 user nova-compute[71330]: WARNING nova.compute.manager [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received unexpected event network-vif-plugged-b417bb86-4450-4242-b710-0a5dd06d6777 for instance with vm_state building and task_state spawning.
Apr 14 11:57:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received event network-vif-plugged-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] Acquiring lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] No waiting events found dispatching network-vif-plugged-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:21 user nova-compute[71330]: WARNING nova.compute.manager [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received unexpected event network-vif-plugged-b417bb86-4450-4242-b710-0a5dd06d6777 for instance with vm_state building and task_state spawning.
Apr 14 11:57:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473441.3227932, 3a308eef-321e-45c9-bc63-f99c4eacef85 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] VM Resumed (Lifecycle Event)
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:21 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Instance spawned successfully.
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473441.3261392, 3a308eef-321e-45c9-bc63-f99c4eacef85 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] VM Started (Lifecycle Event)
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:21 user nova-compute[71330]: INFO nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Took 18.11 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:21 user nova-compute[71330]: INFO nova.compute.manager [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Took 19.05 seconds to build instance.
Apr 14 11:57:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.178s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:57:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:24 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:57:24 user nova-compute[71330]: INFO nova.compute.claims [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Claim successful on node user
Apr 14 11:57:25 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:57:25 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:57:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:57:25 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Creating image(s)
Apr 14 11:57:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "/opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "/opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "/opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.315s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.167s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG nova.policy [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '390ba60eb6f3478fb8225976ee516218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1dde7a2b6d498cbb829c51bfafadee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk 1073741824" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.155s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Cannot resize image /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'migration_context' on Instance uuid 47955121-a299-4b9b-aa83-0e55cfb52f4b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Ensure instance console log exists: /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:57:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:57:27 user nova-compute[71330]: INFO nova.compute.claims [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Claim successful on node user
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Successfully created port: c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:57:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Creating image(s)
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "/opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "/opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "bbbb7e6250328c8fbb6efbe4973900531e7386ce" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "bbbb7e6250328c8fbb6efbe4973900531e7386ce" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:57:29 user nova-compute[71330]: INFO nova.compute.claims [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Claim successful on node user
Apr 14 11:57:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:29 user nova-compute[71330]: DEBUG nova.policy [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30b06ef2f13f421c967f4c86c46e5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35ab5f0a0e2453a8c5ad32e11aca784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:57:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce.part --force-share --output=json" returned: 0 in 0.225s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:29 user nova-compute[71330]: DEBUG nova.virt.images [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] dc9523c9-daf3-4272-8e02-b92a3a7c0d83 was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 11:57:29 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:57:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce.part /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce.part /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce.converted" returned: 0 in 0.215s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.network.neutron [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Successfully updated port: c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "refresh_cache-47955121-a299-4b9b-aa83-0e55cfb52f4b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquired lock "refresh_cache-47955121-a299-4b9b-aa83-0e55cfb52f4b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.network.neutron [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "bbbb7e6250328c8fbb6efbe4973900531e7386ce" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.286s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received event network-changed-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Refreshing instance network info cache due to event network-changed-c9d9e100-59bd-4f58-8892-80c764c88b85. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] Acquiring lock "refresh_cache-47955121-a299-4b9b-aa83-0e55cfb52f4b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.network.neutron [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.391s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce --force-share --output=json" returned: 0 in 0.230s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "bbbb7e6250328c8fbb6efbe4973900531e7386ce" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "bbbb7e6250328c8fbb6efbe4973900531e7386ce" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce --force-share --output=json" returned: 0 in 0.239s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce,backing_fmt=raw /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce,backing_fmt=raw /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk 1073741824" returned: 0 in 0.120s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "bbbb7e6250328c8fbb6efbe4973900531e7386ce" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.policy [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99b28366f58e4c6b95d0f9d39ae73fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8170ca28d84853b1e641b5acbb9708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.network.neutron [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Updating instance_info_cache with network_info: [{"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Releasing lock "refresh_cache-47955121-a299-4b9b-aa83-0e55cfb52f4b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Instance network_info: |[{"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] Acquired lock "refresh_cache-47955121-a299-4b9b-aa83-0e55cfb52f4b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.network.neutron [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Refreshing network info cache for port c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Start _get_guest_xml network_info=[{"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce --force-share --output=json" returned: 0 in 0.285s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:57:31 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Creating image(s)
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "/opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "/opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "/opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Successfully created port: 4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:31 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:31 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1977536204',display_name='tempest-VolumesAdminNegativeTest-server-1977536204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1977536204',id=7,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcMkB0c1UH4Qtwm8SiFLUTXerz4U0APq2enYwPi8/yWkRE0BQ2u6+QDFCAZbkZ1czueB4QHKXGQgV/9QKHiS1kueXwHdrPuJh/RwtOe2sBeAn35kuAmGoqUmSVUTssnzg==',key_name='tempest-keypair-331968736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1dde7a2b6d498cbb829c51bfafadee',ramdisk_id='',reservation_id='r-emzw46y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1955614665',owner_user_name='tempest-VolumesAdminNegativeTest-1955614665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='390ba60eb6f3478fb8225976ee516218',uuid=47955121-a299-4b9b-aa83-0e55cfb52f4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converting VIF {"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:07:30,bridge_name='br-int',has_traffic_filtering=True,id=c9d9e100-59bd-4f58-8892-80c764c88b85,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d9e100-59') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.objects.instance [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'pci_devices' on Instance uuid 47955121-a299-4b9b-aa83-0e55cfb52f4b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.182s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Cannot resize image /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.objects.instance [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lazy-loading 'migration_context' on Instance uuid 8c623c90-6b65-4de1-a67a-c7f667aa2d8d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:31 user nova-compute[71330]:   <uuid>47955121-a299-4b9b-aa83-0e55cfb52f4b</uuid>
Apr 14 11:57:31 user nova-compute[71330]:   <name>instance-00000007</name>
Apr 14 11:57:31 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:31 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:31 user nova-compute[71330]:   <metadata>
Apr 14 11:57:31 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:31 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:31 user nova-compute[71330]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1977536204</nova:name>
Apr 14 11:57:31 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:31</nova:creationTime>
Apr 14 11:57:31 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:31 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:31 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:31 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:31 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:31 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:31 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:31 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:31 user nova-compute[71330]:         <nova:user uuid="390ba60eb6f3478fb8225976ee516218">tempest-VolumesAdminNegativeTest-1955614665-project-member</nova:user>
Apr 14 11:57:31 user nova-compute[71330]:         <nova:project uuid="8d1dde7a2b6d498cbb829c51bfafadee">tempest-VolumesAdminNegativeTest-1955614665</nova:project>
Apr 14 11:57:31 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:31 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:57:31 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:31 user nova-compute[71330]:         <nova:port uuid="c9d9e100-59bd-4f58-8892-80c764c88b85">
Apr 14 11:57:31 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 11:57:31 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:31 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:31 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:31 user nova-compute[71330]:   </metadata>
Apr 14 11:57:31 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:31 user nova-compute[71330]:     <system>
Apr 14 11:57:31 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:31 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:31 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:31 user nova-compute[71330]:       <entry name="serial">47955121-a299-4b9b-aa83-0e55cfb52f4b</entry>
Apr 14 11:57:31 user nova-compute[71330]:       <entry name="uuid">47955121-a299-4b9b-aa83-0e55cfb52f4b</entry>
Apr 14 11:57:31 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:31 user nova-compute[71330]:     </system>
Apr 14 11:57:31 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:31 user nova-compute[71330]:   <os>
Apr 14 11:57:31 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:31 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:31 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:31 user nova-compute[71330]:   </os>
Apr 14 11:57:31 user nova-compute[71330]:   <features>
Apr 14 11:57:31 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:31 user nova-compute[71330]:     <apic/>
Apr 14 11:57:31 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:31 user nova-compute[71330]:   </features>
Apr 14 11:57:31 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:31 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:31 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:31 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:31 user nova-compute[71330]:   </clock>
Apr 14 11:57:31 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:31 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:31 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:31 user nova-compute[71330]:   </cpu>
Apr 14 11:57:31 user nova-compute[71330]:   <devices>
Apr 14 11:57:31 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:31 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:31 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk"/>
Apr 14 11:57:31 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:57:31 user nova-compute[71330]:     </disk>
Apr 14 11:57:31 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:31 user nova-compute[71330]:       <mac address="fa:16:3e:57:07:30"/>
Apr 14 11:57:31 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:31 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:31 user nova-compute[71330]:       <target dev="tapc9d9e100-59"/>
Apr 14 11:57:31 user nova-compute[71330]:     </interface>
Apr 14 11:57:31 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:31 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/console.log" append="off"/>
Apr 14 11:57:31 user nova-compute[71330]:     </serial>
Apr 14 11:57:31 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:31 user nova-compute[71330]:     <video>
Apr 14 11:57:31 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:31 user nova-compute[71330]:     </video>
Apr 14 11:57:31 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:31 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:31 user nova-compute[71330]:     </rng>
Apr 14 11:57:31 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:31 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:31 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:31 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:31 user nova-compute[71330]:   </devices>
Apr 14 11:57:31 user nova-compute[71330]: </domain>
Apr 14 11:57:31 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1977536204',display_name='tempest-VolumesAdminNegativeTest-server-1977536204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1977536204',id=7,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcMkB0c1UH4Qtwm8SiFLUTXerz4U0APq2enYwPi8/yWkRE0BQ2u6+QDFCAZbkZ1czueB4QHKXGQgV/9QKHiS1kueXwHdrPuJh/RwtOe2sBeAn35kuAmGoqUmSVUTssnzg==',key_name='tempest-keypair-331968736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1dde7a2b6d498cbb829c51bfafadee',ramdisk_id='',reservation_id='r-emzw46y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1955614665',owner_user_name='tempest-VolumesAdminNegativeTest-1955614665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='390ba60eb6f3478fb8225976ee516218',uuid=47955121-a299-4b9b-aa83-0e55cfb52f4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converting VIF {"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:07:30,bridge_name='br-int',has_traffic_filtering=True,id=c9d9e100-59bd-4f58-8892-80c764c88b85,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d9e100-59') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG os_vif [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:07:30,bridge_name='br-int',has_traffic_filtering=True,id=c9d9e100-59bd-4f58-8892-80c764c88b85,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d9e100-59') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9d9e100-59, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9d9e100-59, col_values=(('external_ids', {'iface-id': 'c9d9e100-59bd-4f58-8892-80c764c88b85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:07:30', 'vm-uuid': '47955121-a299-4b9b-aa83-0e55cfb52f4b'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Ensure instance console log exists: /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:31 user nova-compute[71330]: INFO os_vif [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:07:30,bridge_name='br-int',has_traffic_filtering=True,id=c9d9e100-59bd-4f58-8892-80c764c88b85,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d9e100-59')
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.170s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk 1073741824" returned: 0 in 0.065s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] No VIF found with MAC fa:16:3e:57:07:30, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.241s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Cannot resize image /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:57:31 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lazy-loading 'migration_context' on Instance uuid 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:57:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Ensure instance console log exists: /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:57:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Updated VIF entry in instance network info cache for port c9d9e100-59bd-4f58-8892-80c764c88b85. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Updating instance_info_cache with network_info: [{"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] Releasing lock "refresh_cache-47955121-a299-4b9b-aa83-0e55cfb52f4b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Successfully created port: c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Successfully updated port: 4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "refresh_cache-8c623c90-6b65-4de1-a67a-c7f667aa2d8d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquired lock "refresh_cache-8c623c90-6b65-4de1-a67a-c7f667aa2d8d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received event network-changed-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Refreshing instance network info cache due to event network-changed-4a2c37e2-c105-4bee-940b-19f8974cd14b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] Acquiring lock "refresh_cache-8c623c90-6b65-4de1-a67a-c7f667aa2d8d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Updating instance_info_cache with network_info: [{"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Releasing lock "refresh_cache-8c623c90-6b65-4de1-a67a-c7f667aa2d8d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Instance network_info: |[{"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] Acquired lock "refresh_cache-8c623c90-6b65-4de1-a67a-c7f667aa2d8d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Refreshing network info cache for port 4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Start _get_guest_xml network_info=[{"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:57:13Z,direct_url=<?>,disk_format='qcow2',id=dc9523c9-daf3-4272-8e02-b92a3a7c0d83,min_disk=0,min_ram=0,name='',owner='aba0bbe2da20426e92443750a50a393e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:57:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_options': None, 'device_name': '/dev/sda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'dc9523c9-daf3-4272-8e02-b92a3a7c0d83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:33 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:33 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:57:13Z,direct_url=<?>,disk_format='qcow2',id=dc9523c9-daf3-4272-8e02-b92a3a7c0d83,min_disk=0,min_ram=0,name='',owner='aba0bbe2da20426e92443750a50a393e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:57:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1705502030',display_name='tempest-AttachSCSIVolumeTestJSON-server-1705502030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1705502030',id=8,image_ref='dc9523c9-daf3-4272-8e02-b92a3a7c0d83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/hlJvXTsRRVQvidTptIsRMFnw3Jy3r5uWyt2kDmqw36j4Asj/F788AI8sVwzfK2jtJbozkD60b+PDsNysUI98/94z1eLuz7MUzjnwC4PtQItCXh82r9AOr1jQqnNZSYw==',key_name='tempest-keypair-553945765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f35ab5f0a0e2453a8c5ad32e11aca784',ramdisk_id='',reservation_id='r-5aigq5o0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dc9523c9-daf3-4272-8e02-b92a3a7c0d83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-291907837',owner_user_name='tempest-AttachSCSIVolumeTestJSON-291907837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30b06ef2f13f421c967f4c86c46e5293',uuid=8c623c90-6b65-4de1-a67a-c7f667aa2d8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Converting VIF {"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:a7:37,bridge_name='br-int',has_traffic_filtering=True,id=4a2c37e2-c105-4bee-940b-19f8974cd14b,network=Network(23922266-3224-4b12-b7d2-0e4fd14ac4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c37e2-c1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.objects.instance [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c623c90-6b65-4de1-a67a-c7f667aa2d8d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:33 user nova-compute[71330]:   <uuid>8c623c90-6b65-4de1-a67a-c7f667aa2d8d</uuid>
Apr 14 11:57:33 user nova-compute[71330]:   <name>instance-00000008</name>
Apr 14 11:57:33 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:33 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:33 user nova-compute[71330]:   <metadata>
Apr 14 11:57:33 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:33 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:33 user nova-compute[71330]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1705502030</nova:name>
Apr 14 11:57:33 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:33</nova:creationTime>
Apr 14 11:57:33 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:33 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:33 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:33 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:33 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:33 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:33 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:33 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:33 user nova-compute[71330]:         <nova:user uuid="30b06ef2f13f421c967f4c86c46e5293">tempest-AttachSCSIVolumeTestJSON-291907837-project-member</nova:user>
Apr 14 11:57:33 user nova-compute[71330]:         <nova:project uuid="f35ab5f0a0e2453a8c5ad32e11aca784">tempest-AttachSCSIVolumeTestJSON-291907837</nova:project>
Apr 14 11:57:33 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:33 user nova-compute[71330]:       <nova:root type="image" uuid="dc9523c9-daf3-4272-8e02-b92a3a7c0d83"/>
Apr 14 11:57:33 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:33 user nova-compute[71330]:         <nova:port uuid="4a2c37e2-c105-4bee-940b-19f8974cd14b">
Apr 14 11:57:33 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 11:57:33 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:33 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:33 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:33 user nova-compute[71330]:   </metadata>
Apr 14 11:57:33 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:33 user nova-compute[71330]:     <system>
Apr 14 11:57:33 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:33 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:33 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:33 user nova-compute[71330]:       <entry name="serial">8c623c90-6b65-4de1-a67a-c7f667aa2d8d</entry>
Apr 14 11:57:33 user nova-compute[71330]:       <entry name="uuid">8c623c90-6b65-4de1-a67a-c7f667aa2d8d</entry>
Apr 14 11:57:33 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:33 user nova-compute[71330]:     </system>
Apr 14 11:57:33 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:33 user nova-compute[71330]:   <os>
Apr 14 11:57:33 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:33 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:33 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:33 user nova-compute[71330]:   </os>
Apr 14 11:57:33 user nova-compute[71330]:   <features>
Apr 14 11:57:33 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:33 user nova-compute[71330]:     <apic/>
Apr 14 11:57:33 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:33 user nova-compute[71330]:   </features>
Apr 14 11:57:33 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:33 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:33 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:33 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:33 user nova-compute[71330]:   </clock>
Apr 14 11:57:33 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:33 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:33 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:33 user nova-compute[71330]:   </cpu>
Apr 14 11:57:33 user nova-compute[71330]:   <devices>
Apr 14 11:57:33 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:33 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:33 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk"/>
Apr 14 11:57:33 user nova-compute[71330]:       <target dev="sda" bus="scsi"/>
Apr 14 11:57:33 user nova-compute[71330]:       <address type="drive" controller="0" unit="0"/>
Apr 14 11:57:33 user nova-compute[71330]:     </disk>
Apr 14 11:57:33 user nova-compute[71330]:     <disk type="file" device="cdrom">
Apr 14 11:57:33 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 11:57:33 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk.config"/>
Apr 14 11:57:33 user nova-compute[71330]:       <target dev="sdb" bus="scsi"/>
Apr 14 11:57:33 user nova-compute[71330]:       <address type="drive" controller="0" unit="1"/>
Apr 14 11:57:33 user nova-compute[71330]:     </disk>
Apr 14 11:57:33 user nova-compute[71330]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 11:57:33 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:33 user nova-compute[71330]:       <mac address="fa:16:3e:dd:a7:37"/>
Apr 14 11:57:33 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:33 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:33 user nova-compute[71330]:       <target dev="tap4a2c37e2-c1"/>
Apr 14 11:57:33 user nova-compute[71330]:     </interface>
Apr 14 11:57:33 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:33 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/console.log" append="off"/>
Apr 14 11:57:33 user nova-compute[71330]:     </serial>
Apr 14 11:57:33 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:33 user nova-compute[71330]:     <video>
Apr 14 11:57:33 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:33 user nova-compute[71330]:     </video>
Apr 14 11:57:33 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:33 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:33 user nova-compute[71330]:     </rng>
Apr 14 11:57:33 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:33 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:33 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:33 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:33 user nova-compute[71330]:   </devices>
Apr 14 11:57:33 user nova-compute[71330]: </domain>
Apr 14 11:57:33 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1705502030',display_name='tempest-AttachSCSIVolumeTestJSON-server-1705502030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1705502030',id=8,image_ref='dc9523c9-daf3-4272-8e02-b92a3a7c0d83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/hlJvXTsRRVQvidTptIsRMFnw3Jy3r5uWyt2kDmqw36j4Asj/F788AI8sVwzfK2jtJbozkD60b+PDsNysUI98/94z1eLuz7MUzjnwC4PtQItCXh82r9AOr1jQqnNZSYw==',key_name='tempest-keypair-553945765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f35ab5f0a0e2453a8c5ad32e11aca784',ramdisk_id='',reservation_id='r-5aigq5o0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dc9523c9-daf3-4272-8e02-b92a3a7c0d83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-291907837',owner_user_name='tempest-AttachSCSIVolumeTestJSON-291907837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30b06ef2f13f421c967f4c86c46e5293',uuid=8c623c90-6b65-4de1-a67a-c7f667aa2d8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Converting VIF {"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:a7:37,bridge_name='br-int',has_traffic_filtering=True,id=4a2c37e2-c105-4bee-940b-19f8974cd14b,network=Network(23922266-3224-4b12-b7d2-0e4fd14ac4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c37e2-c1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG os_vif [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:a7:37,bridge_name='br-int',has_traffic_filtering=True,id=4a2c37e2-c105-4bee-940b-19f8974cd14b,network=Network(23922266-3224-4b12-b7d2-0e4fd14ac4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c37e2-c1') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a2c37e2-c1, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a2c37e2-c1, col_values=(('external_ids', {'iface-id': '4a2c37e2-c105-4bee-940b-19f8974cd14b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:a7:37', 'vm-uuid': '8c623c90-6b65-4de1-a67a-c7f667aa2d8d'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:57:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:33 user nova-compute[71330]: INFO os_vif [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:a7:37,bridge_name='br-int',has_traffic_filtering=True,id=4a2c37e2-c105-4bee-940b-19f8974cd14b,network=Network(23922266-3224-4b12-b7d2-0e4fd14ac4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c37e2-c1')
Apr 14 11:57:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] No BDM found with device name sda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] No VIF found with MAC fa:16:3e:dd:a7:37, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:34 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Using config drive
Apr 14 11:57:34 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Creating config drive at /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk.config
Apr 14 11:57:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy7qdnlk5 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy7qdnlk5" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] There are 0 instances to clean {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances with incomplete migration  {{(pid=71330) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:34 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Successfully updated port: c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "refresh_cache-34c3100c-5b90-47a1-8c3b-fb53467fcd20" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquired lock "refresh_cache-34c3100c-5b90-47a1-8c3b-fb53467fcd20" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received event network-vif-plugged-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] No waiting events found dispatching network-vif-plugged-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:35 user nova-compute[71330]: WARNING nova.compute.manager [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received unexpected event network-vif-plugged-c9d9e100-59bd-4f58-8892-80c764c88b85 for instance with vm_state building and task_state spawning.
Apr 14 11:57:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received event network-changed-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Refreshing instance network info cache due to event network-changed-c7a8788d-e6ec-4958-8755-b88f421793c3. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] Acquiring lock "refresh_cache-34c3100c-5b90-47a1-8c3b-fb53467fcd20" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG nova.network.neutron [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Updated VIF entry in instance network info cache for port 4a2c37e2-c105-4bee-940b-19f8974cd14b. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG nova.network.neutron [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Updating instance_info_cache with network_info: [{"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] Releasing lock "refresh_cache-8c623c90-6b65-4de1-a67a-c7f667aa2d8d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Updating instance_info_cache with network_info: [{"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Releasing lock "refresh_cache-34c3100c-5b90-47a1-8c3b-fb53467fcd20" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Instance network_info: |[{"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] Acquired lock "refresh_cache-34c3100c-5b90-47a1-8c3b-fb53467fcd20" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.network.neutron [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Refreshing network info cache for port c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Start _get_guest_xml network_info=[{"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:36 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:36 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-92977634',display_name='tempest-TestVolumeSwap-server-92977634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-92977634',id=9,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNK1h/THvT6cq6N0iVdaxJtF4N+zyijAbwCt203K+qT3+6nOD7jWDcOnyxbv9yde5KURkOBZ+7kcCeoteXvV9dRD/N/+bb1bDR6/Vzy+7NKcyHQueXPA551IaXtV4F3A4Q==',key_name='tempest-keypair-1235067215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec8170ca28d84853b1e641b5acbb9708',ramdisk_id='',reservation_id='r-eouthc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1357355751',owner_user_name='tempest-TestVolumeSwap-1357355751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b28366f58e4c6b95d0f9d39ae73fbe',uuid=34c3100c-5b90-47a1-8c3b-fb53467fcd20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Converting VIF {"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:b4:c4,bridge_name='br-int',has_traffic_filtering=True,id=c7a8788d-e6ec-4958-8755-b88f421793c3,network=Network(0a15f87a-0ea8-4073-a37d-3c81f8de3dc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a8788d-e6') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lazy-loading 'pci_devices' on Instance uuid 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:36 user nova-compute[71330]:   <uuid>34c3100c-5b90-47a1-8c3b-fb53467fcd20</uuid>
Apr 14 11:57:36 user nova-compute[71330]:   <name>instance-00000009</name>
Apr 14 11:57:36 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:36 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:36 user nova-compute[71330]:   <metadata>
Apr 14 11:57:36 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:36 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:36 user nova-compute[71330]:       <nova:name>tempest-TestVolumeSwap-server-92977634</nova:name>
Apr 14 11:57:36 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:36</nova:creationTime>
Apr 14 11:57:36 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:36 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:36 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:36 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:36 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:36 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:36 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:36 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:36 user nova-compute[71330]:         <nova:user uuid="99b28366f58e4c6b95d0f9d39ae73fbe">tempest-TestVolumeSwap-1357355751-project-member</nova:user>
Apr 14 11:57:36 user nova-compute[71330]:         <nova:project uuid="ec8170ca28d84853b1e641b5acbb9708">tempest-TestVolumeSwap-1357355751</nova:project>
Apr 14 11:57:36 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:36 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:57:36 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:36 user nova-compute[71330]:         <nova:port uuid="c7a8788d-e6ec-4958-8755-b88f421793c3">
Apr 14 11:57:36 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 11:57:36 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:36 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:36 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:36 user nova-compute[71330]:   </metadata>
Apr 14 11:57:36 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:36 user nova-compute[71330]:     <system>
Apr 14 11:57:36 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:36 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:36 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:36 user nova-compute[71330]:       <entry name="serial">34c3100c-5b90-47a1-8c3b-fb53467fcd20</entry>
Apr 14 11:57:36 user nova-compute[71330]:       <entry name="uuid">34c3100c-5b90-47a1-8c3b-fb53467fcd20</entry>
Apr 14 11:57:36 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:36 user nova-compute[71330]:     </system>
Apr 14 11:57:36 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:36 user nova-compute[71330]:   <os>
Apr 14 11:57:36 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:36 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:36 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:36 user nova-compute[71330]:   </os>
Apr 14 11:57:36 user nova-compute[71330]:   <features>
Apr 14 11:57:36 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:36 user nova-compute[71330]:     <apic/>
Apr 14 11:57:36 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:36 user nova-compute[71330]:   </features>
Apr 14 11:57:36 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:36 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:36 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:36 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:36 user nova-compute[71330]:   </clock>
Apr 14 11:57:36 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:36 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:36 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:36 user nova-compute[71330]:   </cpu>
Apr 14 11:57:36 user nova-compute[71330]:   <devices>
Apr 14 11:57:36 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:36 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:36 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk"/>
Apr 14 11:57:36 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:57:36 user nova-compute[71330]:     </disk>
Apr 14 11:57:36 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:36 user nova-compute[71330]:       <mac address="fa:16:3e:35:b4:c4"/>
Apr 14 11:57:36 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:36 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:36 user nova-compute[71330]:       <target dev="tapc7a8788d-e6"/>
Apr 14 11:57:36 user nova-compute[71330]:     </interface>
Apr 14 11:57:36 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:36 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/console.log" append="off"/>
Apr 14 11:57:36 user nova-compute[71330]:     </serial>
Apr 14 11:57:36 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:36 user nova-compute[71330]:     <video>
Apr 14 11:57:36 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:36 user nova-compute[71330]:     </video>
Apr 14 11:57:36 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:36 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:36 user nova-compute[71330]:     </rng>
Apr 14 11:57:36 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:36 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:36 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:36 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:36 user nova-compute[71330]:   </devices>
Apr 14 11:57:36 user nova-compute[71330]: </domain>
Apr 14 11:57:36 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-92977634',display_name='tempest-TestVolumeSwap-server-92977634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-92977634',id=9,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNK1h/THvT6cq6N0iVdaxJtF4N+zyijAbwCt203K+qT3+6nOD7jWDcOnyxbv9yde5KURkOBZ+7kcCeoteXvV9dRD/N/+bb1bDR6/Vzy+7NKcyHQueXPA551IaXtV4F3A4Q==',key_name='tempest-keypair-1235067215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec8170ca28d84853b1e641b5acbb9708',ramdisk_id='',reservation_id='r-eouthc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1357355751',owner_user_name='tempest-TestVolumeSwap-1357355751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b28366f58e4c6b95d0f9d39ae73fbe',uuid=34c3100c-5b90-47a1-8c3b-fb53467fcd20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Converting VIF {"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:b4:c4,bridge_name='br-int',has_traffic_filtering=True,id=c7a8788d-e6ec-4958-8755-b88f421793c3,network=Network(0a15f87a-0ea8-4073-a37d-3c81f8de3dc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a8788d-e6') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG os_vif [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:b4:c4,bridge_name='br-int',has_traffic_filtering=True,id=c7a8788d-e6ec-4958-8755-b88f421793c3,network=Network(0a15f87a-0ea8-4073-a37d-3c81f8de3dc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a8788d-e6') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7a8788d-e6, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7a8788d-e6, col_values=(('external_ids', {'iface-id': 'c7a8788d-e6ec-4958-8755-b88f421793c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:b4:c4', 'vm-uuid': '34c3100c-5b90-47a1-8c3b-fb53467fcd20'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:57:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:36 user nova-compute[71330]: INFO os_vif [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:b4:c4,bridge_name='br-int',has_traffic_filtering=True,id=c7a8788d-e6ec-4958-8755-b88f421793c3,network=Network(0a15f87a-0ea8-4073-a37d-3c81f8de3dc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a8788d-e6')
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] No VIF found with MAC fa:16:3e:35:b4:c4, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473457.6484134, 47955121-a299-4b9b-aa83-0e55cfb52f4b => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] VM Resumed (Lifecycle Event)
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Instance spawned successfully.
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Skipping network cache update for instance because it is Building. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Skipping network cache update for instance because it is Building. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Skipping network cache update for instance because it is Building. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received event network-vif-plugged-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] No waiting events found dispatching network-vif-plugged-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:37 user nova-compute[71330]: WARNING nova.compute.manager [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received unexpected event network-vif-plugged-c9d9e100-59bd-4f58-8892-80c764c88b85 for instance with vm_state building and task_state spawning.
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received event network-vif-plugged-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] No waiting events found dispatching network-vif-plugged-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:37 user nova-compute[71330]: WARNING nova.compute.manager [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received unexpected event network-vif-plugged-4a2c37e2-c105-4bee-940b-19f8974cd14b for instance with vm_state building and task_state spawning.
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473457.6509645, 47955121-a299-4b9b-aa83-0e55cfb52f4b => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] VM Started (Lifecycle Event)
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:37 user nova-compute[71330]: INFO nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Took 12.19 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:38 user nova-compute[71330]: INFO nova.compute.manager [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Took 13.56 seconds to build instance.
Apr 14 11:57:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.869s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG nova.network.neutron [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Updated VIF entry in instance network info cache for port c7a8788d-e6ec-4958-8755-b88f421793c3. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG nova.network.neutron [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Updating instance_info_cache with network_info: [{"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] Releasing lock "refresh_cache-34c3100c-5b90-47a1-8c3b-fb53467fcd20" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updating instance_info_cache with network_info: [{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:57:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received event network-vif-plugged-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] No waiting events found dispatching network-vif-plugged-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:39 user nova-compute[71330]: WARNING nova.compute.manager [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received unexpected event network-vif-plugged-c7a8788d-e6ec-4958-8755-b88f421793c3 for instance with vm_state building and task_state spawning.
Apr 14 11:57:39 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received event network-vif-plugged-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] No waiting events found dispatching network-vif-plugged-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:39 user nova-compute[71330]: WARNING nova.compute.manager [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received unexpected event network-vif-plugged-4a2c37e2-c105-4bee-940b-19f8974cd14b for instance with vm_state building and task_state spawning.
Apr 14 11:57:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:40 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:57:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:40 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:57:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473461.3354506, 8c623c90-6b65-4de1-a67a-c7f667aa2d8d => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:41 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] VM Resumed (Lifecycle Event)
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:41 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Instance spawned successfully.
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:41 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473461.3401322, 8c623c90-6b65-4de1-a67a-c7f667aa2d8d => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:41 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] VM Started (Lifecycle Event)
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received event network-vif-plugged-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] No waiting events found dispatching network-vif-plugged-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:41 user nova-compute[71330]: WARNING nova.compute.manager [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received unexpected event network-vif-plugged-c7a8788d-e6ec-4958-8755-b88f421793c3 for instance with vm_state building and task_state spawning.
Apr 14 11:57:41 user nova-compute[71330]: INFO nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Took 12.71 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:41 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:41 user nova-compute[71330]: INFO nova.compute.manager [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Took 14.10 seconds to build instance.
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.230s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473461.9240015, 34c3100c-5b90-47a1-8c3b-fb53467fcd20 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:41 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] VM Resumed (Lifecycle Event)
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:41 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Instance spawned successfully.
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:42 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:42 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473461.9263487, 34c3100c-5b90-47a1-8c3b-fb53467fcd20 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:42 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] VM Started (Lifecycle Event)
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:42 user nova-compute[71330]: INFO nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Took 10.98 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:42 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:42 user nova-compute[71330]: INFO nova.compute.manager [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Took 13.36 seconds to build instance.
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.520s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:45 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:45 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:45 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7771MB free_disk=26.683731079101562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:57:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 252824ed-0978-4f05-b03e-4d92057ce3ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing inventories for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating ProviderTree inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing aggregate associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, aggregates: None {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing trait associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.213s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:57:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:57:48 user nova-compute[71330]: INFO nova.compute.claims [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Claim successful on node user
Apr 14 11:57:49 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG nova.network.neutron [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:57:49 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:57:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:57:49 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Creating image(s)
Apr 14 11:57:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "/opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "/opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "/opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "cf6c2f3f7fc528ccc17b24dcae63acac335a38b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "cf6c2f3f7fc528ccc17b24dcae63acac335a38b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG nova.policy [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2.part --force-share --output=json" returned: 0 in 0.168s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG nova.virt.images [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] e352d0f0-b1ad-42b1-b85d-d82679cbae9f was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2.part /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2.part /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2.converted" returned: 0 in 0.196s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "cf6c2f3f7fc528ccc17b24dcae63acac335a38b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.954s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2 --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "cf6c2f3f7fc528ccc17b24dcae63acac335a38b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "cf6c2f3f7fc528ccc17b24dcae63acac335a38b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2 --force-share --output=json" returned: 0 in 0.161s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2,backing_fmt=raw /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2,backing_fmt=raw /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk 1073741824" returned: 0 in 0.074s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "cf6c2f3f7fc528ccc17b24dcae63acac335a38b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2 --force-share --output=json" returned: 0 in 0.170s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG nova.network.neutron [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Successfully created port: 1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Cannot resize image /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG nova.objects.instance [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'migration_context' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Ensure instance console log exists: /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Successfully updated port: 1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquired lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing instance network info cache due to event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] Acquiring lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating instance_info_cache with network_info: [{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Releasing lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Instance network_info: |[{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] Acquired lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.network.neutron [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Start _get_guest_xml network_info=[{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:57:44Z,direct_url=<?>,disk_format='qcow2',id=e352d0f0-b1ad-42b1-b85d-d82679cbae9f,min_disk=0,min_ram=0,name='tempest-scenario-img--488924508',owner='cd9936aa363942f6a01bb64a8a8e74c9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:57:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e352d0f0-b1ad-42b1-b85d-d82679cbae9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:57:52 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:52 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:57:44Z,direct_url=<?>,disk_format='qcow2',id=e352d0f0-b1ad-42b1-b85d-d82679cbae9f,min_disk=0,min_ram=0,name='tempest-scenario-img--488924508',owner='cd9936aa363942f6a01bb64a8a8e74c9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:57:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1398086214',display_name='tempest-TestMinimumBasicScenario-server-1398086214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1398086214',id=10,image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFIiKeQ/0Z0VfNZ6VUUlM9T5nZwFyI0LyXC8IRlH9W30muvQjtYrEeJ005baAqyTH/3Er2lAxmVvPn8aYg78pz/L256wjoD0MsMUEVdNJFcrEot77mjLycf8/vwxTsgA==',key_name='tempest-TestMinimumBasicScenario-565940781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd9936aa363942f6a01bb64a8a8e74c9',ramdisk_id='',reservation_id='r-awo3v0q9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-881161311',owner_user_name='tempest-TestMinimumBasicScenario-881161311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:50Z,user_data=None,user_id='2eb32a03e7e04da18568294cca0e69bd',uuid=25eda1c2-9b82-412f-b75d-358e87847a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converting VIF {"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.objects.instance [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'pci_devices' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:57:52 user nova-compute[71330]:   <uuid>25eda1c2-9b82-412f-b75d-358e87847a29</uuid>
Apr 14 11:57:52 user nova-compute[71330]:   <name>instance-0000000a</name>
Apr 14 11:57:52 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:57:52 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:57:52 user nova-compute[71330]:   <metadata>
Apr 14 11:57:52 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:57:52 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:57:52 user nova-compute[71330]:       <nova:name>tempest-TestMinimumBasicScenario-server-1398086214</nova:name>
Apr 14 11:57:52 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:57:52</nova:creationTime>
Apr 14 11:57:52 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:57:52 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:57:52 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:57:52 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:57:52 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:57:52 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:57:52 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:57:52 user nova-compute[71330]:       <nova:owner>
Apr 14 11:57:52 user nova-compute[71330]:         <nova:user uuid="2eb32a03e7e04da18568294cca0e69bd">tempest-TestMinimumBasicScenario-881161311-project-member</nova:user>
Apr 14 11:57:52 user nova-compute[71330]:         <nova:project uuid="cd9936aa363942f6a01bb64a8a8e74c9">tempest-TestMinimumBasicScenario-881161311</nova:project>
Apr 14 11:57:52 user nova-compute[71330]:       </nova:owner>
Apr 14 11:57:52 user nova-compute[71330]:       <nova:root type="image" uuid="e352d0f0-b1ad-42b1-b85d-d82679cbae9f"/>
Apr 14 11:57:52 user nova-compute[71330]:       <nova:ports>
Apr 14 11:57:52 user nova-compute[71330]:         <nova:port uuid="1aad7982-a338-4425-9e53-ea99f31b0de6">
Apr 14 11:57:52 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 11:57:52 user nova-compute[71330]:         </nova:port>
Apr 14 11:57:52 user nova-compute[71330]:       </nova:ports>
Apr 14 11:57:52 user nova-compute[71330]:     </nova:instance>
Apr 14 11:57:52 user nova-compute[71330]:   </metadata>
Apr 14 11:57:52 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:57:52 user nova-compute[71330]:     <system>
Apr 14 11:57:52 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:57:52 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:57:52 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:57:52 user nova-compute[71330]:       <entry name="serial">25eda1c2-9b82-412f-b75d-358e87847a29</entry>
Apr 14 11:57:52 user nova-compute[71330]:       <entry name="uuid">25eda1c2-9b82-412f-b75d-358e87847a29</entry>
Apr 14 11:57:52 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:57:52 user nova-compute[71330]:     </system>
Apr 14 11:57:52 user nova-compute[71330]:   </sysinfo>
Apr 14 11:57:52 user nova-compute[71330]:   <os>
Apr 14 11:57:52 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:57:52 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:57:52 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:57:52 user nova-compute[71330]:   </os>
Apr 14 11:57:52 user nova-compute[71330]:   <features>
Apr 14 11:57:52 user nova-compute[71330]:     <acpi/>
Apr 14 11:57:52 user nova-compute[71330]:     <apic/>
Apr 14 11:57:52 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:57:52 user nova-compute[71330]:   </features>
Apr 14 11:57:52 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:57:52 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:57:52 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:57:52 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:57:52 user nova-compute[71330]:   </clock>
Apr 14 11:57:52 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:57:52 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:57:52 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:57:52 user nova-compute[71330]:   </cpu>
Apr 14 11:57:52 user nova-compute[71330]:   <devices>
Apr 14 11:57:52 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:57:52 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:57:52 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk"/>
Apr 14 11:57:52 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:57:52 user nova-compute[71330]:     </disk>
Apr 14 11:57:52 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:57:52 user nova-compute[71330]:       <mac address="fa:16:3e:4f:d4:34"/>
Apr 14 11:57:52 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:52 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:57:52 user nova-compute[71330]:       <target dev="tap1aad7982-a3"/>
Apr 14 11:57:52 user nova-compute[71330]:     </interface>
Apr 14 11:57:52 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:57:52 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/console.log" append="off"/>
Apr 14 11:57:52 user nova-compute[71330]:     </serial>
Apr 14 11:57:52 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:57:52 user nova-compute[71330]:     <video>
Apr 14 11:57:52 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:57:52 user nova-compute[71330]:     </video>
Apr 14 11:57:52 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:57:52 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:57:52 user nova-compute[71330]:     </rng>
Apr 14 11:57:52 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:57:52 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:57:52 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:57:52 user nova-compute[71330]:     </memballoon>
Apr 14 11:57:52 user nova-compute[71330]:   </devices>
Apr 14 11:57:52 user nova-compute[71330]: </domain>
Apr 14 11:57:52 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1398086214',display_name='tempest-TestMinimumBasicScenario-server-1398086214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1398086214',id=10,image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFIiKeQ/0Z0VfNZ6VUUlM9T5nZwFyI0LyXC8IRlH9W30muvQjtYrEeJ005baAqyTH/3Er2lAxmVvPn8aYg78pz/L256wjoD0MsMUEVdNJFcrEot77mjLycf8/vwxTsgA==',key_name='tempest-TestMinimumBasicScenario-565940781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd9936aa363942f6a01bb64a8a8e74c9',ramdisk_id='',reservation_id='r-awo3v0q9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-881161311',owner_user_name='tempest-TestMinimumBasicScenario-881161311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:50Z,user_data=None,user_id='2eb32a03e7e04da18568294cca0e69bd',uuid=25eda1c2-9b82-412f-b75d-358e87847a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converting VIF {"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG os_vif [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aad7982-a3, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1aad7982-a3, col_values=(('external_ids', {'iface-id': '1aad7982-a338-4425-9e53-ea99f31b0de6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:d4:34', 'vm-uuid': '25eda1c2-9b82-412f-b75d-358e87847a29'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:57:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:52 user nova-compute[71330]: INFO os_vif [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3')
Apr 14 11:57:53 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:57:53 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No VIF found with MAC fa:16:3e:4f:d4:34, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:57:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updated VIF entry in instance network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:57:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating instance_info_cache with network_info: [{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:57:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] Releasing lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:57:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] No waiting events found dispatching network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:54 user nova-compute[71330]: WARNING nova.compute.manager [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received unexpected event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 for instance with vm_state building and task_state spawning.
Apr 14 11:57:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "b97d3633-4864-45fa-8d87-968507e13639" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:57:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:56 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:57:56 user nova-compute[71330]: INFO nova.compute.claims [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Claim successful on node user
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] No waiting events found dispatching network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:57:57 user nova-compute[71330]: WARNING nova.compute.manager [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received unexpected event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 for instance with vm_state building and task_state spawning.
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473477.1446362, 25eda1c2-9b82-412f-b75d-358e87847a29 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:57 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] VM Resumed (Lifecycle Event)
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:57:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Instance spawned successfully.
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:57:57 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473477.1481004, 25eda1c2-9b82-412f-b75d-358e87847a29 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:57:57 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] VM Started (Lifecycle Event)
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:57:57 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:57:57 user nova-compute[71330]: INFO nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Took 7.73 seconds to spawn the instance on the hypervisor.
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:57:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:57:57 user nova-compute[71330]: INFO nova.compute.manager [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Took 8.65 seconds to build instance.
Apr 14 11:57:57 user nova-compute[71330]: INFO nova.virt.block_device [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Booting with volume a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 at /dev/vda
Apr 14 11:57:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.786s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG os_brick.utils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:57:57 user nova-compute[71330]: INFO oslo.privsep.daemon [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp_sw5ubgv/privsep.sock']
Apr 14 11:57:57 user sudo[82053]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp_sw5ubgv/privsep.sock
Apr 14 11:57:57 user sudo[82053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 11:57:57 user nova-compute[71330]: DEBUG nova.policy [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:57:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:57:58 user nova-compute[71330]: INFO nova.compute.claims [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Claim successful on node user
Apr 14 11:57:58 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully created port: 6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:57:58 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:57:58 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:57:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:57:59 user nova-compute[71330]: INFO nova.virt.block_device [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Booting with volume 895ab6a9-dbf3-4601-a05b-a462b92efde9 at /dev/vda
Apr 14 11:57:59 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully created port: b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG nova.policy [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG os_brick.utils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully created port: 1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:57:59 user sudo[82053]: pam_unix(sudo:session): session closed for user root
Apr 14 11:57:59 user nova-compute[71330]: INFO oslo.privsep.daemon [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Spawned new privsep daemon via rootwrap
Apr 14 11:57:59 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 11:57:59 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 11:57:59 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 11:57:59 user nova-compute[71330]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82058
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fe42f8-98fa-4aaa-a511-f225e8aa63f0]: (2,) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:57:59 user nova-compute[71330]: WARNING oslo_privsep.priv_context [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] privsep daemon already running
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0d983f-afa9-4987-80a2-d3c6d6cd4e5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:57:59 user nova-compute[71330]: WARNING os_brick.initiator.connectors.nvmeof [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb232c0-75ce-4ffe-ac90-35ced615cbbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adec712-2750-48f3-abd7-204efa90ea2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:57:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[139402bc-f5ea-4463-b1f2-f6e1fe2b7911]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5300b5-867e-4260-87f0-5bf8808d2aaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b9e67-13b1-4de1-b0cd-398e305824a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully created port: e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[94581833-1bc8-4592-a67e-2538da109a53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c59018-028a-46b9-9b1c-39802ae14349]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:00 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9433f9-74c7-4707-a89c-ad6f154a3c3a]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.utils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] <== get_connector_properties: return (935ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating existing volume attachment record: ed7553e6-d2e7-4e25-ad1d-ab2faab23884 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:00 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:58:00 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf0aaf8-6718-4e4b-99e2-c6fa3514ba12]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG os_brick.utils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] <== get_connector_properties: return (2560ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating existing volume attachment record: df1b5693-7c80-441d-805d-d116f171d73a {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully created port: 7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:58:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully created port: 27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:58:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully created port: 18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:58:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully created port: 737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:58:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully created port: 9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:58:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully updated port: 6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-changed-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing instance network info cache due to event network-changed-6ea5022d-9892-4cd9-90a9-4328326b209d. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] Acquiring lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] Acquired lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing network info cache for port 6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully updated port: 314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:03 user nova-compute[71330]: DEBUG nova.network.neutron [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] Releasing lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully created port: 8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:58:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully updated port: 3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully updated port: e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-changed-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing instance network info cache due to event network-changed-e643b092-2a68-4a03-810c-74731525841b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] Acquiring lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] Acquired lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.network.neutron [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing network info cache for port e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-changed-314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing instance network info cache due to event network-changed-314dd23d-4b31-40a2-9a19-37613754a61b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Acquiring lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Acquired lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.network.neutron [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing network info cache for port 314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.network.neutron [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.network.neutron [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully updated port: b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG nova.network.neutron [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] Releasing lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.network.neutron [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:05 user nova-compute[71330]: INFO nova.virt.block_device [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Booting with volume fb07ad60-62ba-467a-87a2-abe53abda98b at /dev/vdb
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Releasing lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-changed-3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing instance network info cache due to event network-changed-3ee869ed-353a-4e35-b0d9-57f8441c91ff. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Acquiring lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Acquired lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.network.neutron [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing network info cache for port 3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:05 user nova-compute[71330]: INFO nova.virt.block_device [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Booting with volume a8da01ce-a845-488b-8e7d-049d79697c6f at /dev/vdb
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.utils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fa948f-ba1f-4915-97a9-bf4c38bc39d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully updated port: a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.network.neutron [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2659a51-f3e3-42f3-a08a-4c70003d4147]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1808818d-3d8d-4795-834d-ace91b1518bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[db026a59-f0f9-4041-8c96-dcd09b02a0b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.utils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[938f9005-9025-4c30-a6d8-a0e4fa797bae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:05 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110864f-7533-45ee-a981-d9d6277df1f5]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.utils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating existing volume attachment record: 0f45ad90-9c96-4e60-9bf3-21b5b3ba2728 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be02453-0bfc-40a6-b52d-f28c97541805]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d61e42-60da-42e7-9f48-164e40e75c9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2becbb43-c886-43b5-bb41-ed454c818810]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:05 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f0358d-3c0e-4ff7-86d6-a921f12cfd82]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG os_brick.utils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating existing volume attachment record: 32e93465-030c-44a7-bb1d-e16ec4a61836 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.network.neutron [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Releasing lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully updated port: 1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully updated port: 56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully updated port: 27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-changed-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing instance network info cache due to event network-changed-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Acquiring lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Acquired lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing network info cache for port a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully updated port: 7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-changed-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing instance network info cache due to event network-changed-b786ac42-d885-4cbb-a03c-5d7c17adfae2. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Acquiring lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Acquired lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing network info cache for port b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Releasing lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-changed-56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing instance network info cache due to event network-changed-56378bcd-5459-47e7-8424-345fc574ebc7. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Acquiring lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Acquired lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing network info cache for port 56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG nova.network.neutron [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG nova.network.neutron [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG nova.network.neutron [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Releasing lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Successfully updated port: 737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG nova.network.neutron [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Releasing lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-changed-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing instance network info cache due to event network-changed-1dc3ed86-ee69-4541-a687-409bb40f1966. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Acquiring lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Acquired lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG nova.network.neutron [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing network info cache for port 1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG nova.network.neutron [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.network.neutron [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Releasing lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-changed-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing instance network info cache due to event network-changed-27a86908-d21f-46e8-a84d-66b055203f9b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Acquiring lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Acquired lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.network.neutron [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing network info cache for port 27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.network.neutron [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully updated port: 18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.network.neutron [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Releasing lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquired lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-changed-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing instance network info cache due to event network-changed-7fc577b9-cdea-45d8-9e73-a5cae3b67eec. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Acquiring lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Acquired lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.network.neutron [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing network info cache for port 7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.network.neutron [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-changed-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing instance network info cache due to event network-changed-737a9bf4-c102-475e-b791-c56b01f23d0d. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] Acquiring lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG nova.network.neutron [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Releasing lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-changed-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing instance network info cache due to event network-changed-18a26f8b-649d-4f0f-865f-cea6cd23372b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Acquiring lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Acquired lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG nova.network.neutron [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing network info cache for port 18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG nova.network.neutron [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG nova.network.neutron [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Releasing lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:09 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully updated port: 9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:10 user nova-compute[71330]: INFO nova.virt.block_device [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Booting with volume 84ffdf09-b386-4f7b-956b-087ab6d671eb at /dev/vdc
Apr 14 11:58:10 user nova-compute[71330]: DEBUG os_brick.utils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc98e73b-bc1b-4cd2-a8f5-c1da51d51857]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfc93b8-cc5f-4020-95d7-dbe47501f24f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[70db5aa2-9e6e-4d35-aba3-1f5c32ef7e93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7c9e6a-402e-4805-8c2c-bd0db0560266]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:10 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7d5452-e50d-4548-a97c-d10dd5488a1d]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG os_brick.utils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating existing volume attachment record: 93e416d7-ab6a-4e08-8af2-e7521dfc9dbb {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-changed-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing instance network info cache due to event network-changed-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] Acquiring lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] Acquired lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing network info cache for port 9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:10 user nova-compute[71330]: INFO nova.virt.block_device [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Booting with volume dda8c2c2-a10a-40f4-99f7-8b65ac91d938 at /dev/vdc
Apr 14 11:58:10 user nova-compute[71330]: DEBUG os_brick.utils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4a7769-23e0-4157-9b44-ea0e9b9f33cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[776e1a52-9c94-4384-ade9-b66a99d5623e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37dc198-9444-4132-bb1e-f3c00109ec62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfa9061-1faf-48f4-a466-fa2adf071733]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG nova.network.neutron [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:11 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[caebe5da-d0f4-41e4-8e70-5ebc4d8fed31]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG os_brick.utils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating existing volume attachment record: d002a2ae-8169-4d78-90ce-6185d73fcc6f {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] Releasing lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Successfully updated port: 8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquired lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:58:11 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:58:12 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [{"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Releasing lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance network_info: |[{"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:58:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] Acquired lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:12 user nova-compute[71330]: DEBUG nova.network.neutron [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing network info cache for port 737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-changed-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing instance network info cache due to event network-changed-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] Acquiring lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:13 user nova-compute[71330]: DEBUG nova.network.neutron [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updated VIF entry in instance network info cache for port 737a9bf4-c102-475e-b791-c56b01f23d0d. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:58:13 user nova-compute[71330]: DEBUG nova.network.neutron [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [{"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] Releasing lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:14 user nova-compute[71330]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [{"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Releasing lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance network_info: |[{"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:58:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] Acquired lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing network info cache for port 8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.network.neutron [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updated VIF entry in instance network info cache for port 8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.network.neutron [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [{"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] Releasing lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:58:15 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Creating image(s)
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Ensure instance console log exists: /opt/stack/data/nova/instances/b97d3633-4864-45fa-8d87-968507e13639/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Start _get_guest_xml network_info=[{"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'df1b5693-7c80-441d-805d-d116f171d73a', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWGCEDIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b97d3633-4864-45fa-8d87-968507e13639', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4b6d7b7-aee4-4c93-8b51-fe6da314cb89', 'serial': 'a4b6d7b7-aee4-4c93-8b51-fe6da314cb89'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '0f45ad90-9c96-4e60-9bf3-21b5b3ba2728', 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsLuUcMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b97d3633-4864-45fa-8d87-968507e13639', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb07ad60-62ba-467a-87a2-abe53abda98b', 'serial': 'fb07ad60-62ba-467a-87a2-abe53abda98b'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '93e416d7-ab6a-4e08-8af2-e7521dfc9dbb', 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHvwcBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b97d3633-4864-45fa-8d87-968507e13639', 'attached_at': '', 'detached_at': '', 'volume_id': '84ffdf09-b386-4f7b-956b-087ab6d671eb', 'serial': '84ffdf09-b386-4f7b-956b-087ab6d671eb'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:58:15 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:58:15 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connector [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Factory for ISCSI on None {{(pid=71330) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWGCEDIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:15 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:15 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:15 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[183e1c98-a6eb-4cbe-8083-fa45890ee436]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:58:15 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[321da098-fe95-4bdf-881d-436421484a39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89] added
Apr 14 11:58:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[915a17f3-5795-4ef3-9f75-b43aa1bc6ef6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d6ba46-41cb-46a5-a73c-831436266bc6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWGCEDIp {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWGCEDIp" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[34544b0a-86d9-4e5b-a744-2931d959a460]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NWGCEDIp'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5ae29-1636-4998-8dc0-b429a48c32d5]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c000677-6824-4424-ad5d-44095fb5b406]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:58:15 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:58:15 user nova-compute[71330]:  {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:15 user nova-compute[71330]: WARNING os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 11:58:15 user nova-compute[71330]: 
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fca729-bf0c-4300-9411-0091864dd04b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89, portal: 172.16.0.220,3260]
Apr 14 11:58:15 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89, portal: 172.16.0.220,3260] successful.
Apr 14 11:58:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:58:15 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Creating image(s)
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Ensure instance console log exists: /opt/stack/data/nova/instances/132e2ee3-a757-42ef-b0ae-3441dca65da5/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Start _get_guest_xml network_info=[{"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'ed7553e6-d2e7-4e25-ad1d-ab2faab23884', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQBTWbrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '132e2ee3-a757-42ef-b0ae-3441dca65da5', 'attached_at': '', 'detached_at': '', 'volume_id': '895ab6a9-dbf3-4601-a05b-a462b92efde9', 'serial': '895ab6a9-dbf3-4601-a05b-a462b92efde9'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '32e93465-030c-44a7-bb1d-e16ec4a61836', 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmIpGdRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '132e2ee3-a757-42ef-b0ae-3441dca65da5', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8da01ce-a845-488b-8e7d-049d79697c6f', 'serial': 'a8da01ce-a845-488b-8e7d-049d79697c6f'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': 'd002a2ae-8169-4d78-90ce-6185d73fcc6f', 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYFfydbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '132e2ee3-a757-42ef-b0ae-3441dca65da5', 'attached_at': '', 'detached_at': '', 'volume_id': 'dda8c2c2-a10a-40f4-99f7-8b65ac91d938', 'serial': 'dda8c2c2-a10a-40f4-99f7-8b65ac91d938'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[861fcfde-a3b4-4a0e-a6b8-a88566fbc695]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:15 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:58:15 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:58:15 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQBTWbrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:16 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4993f64e-0ddb-46c5-982f-ce40a505d3dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:16 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:16 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb262134-0b44-468d-af9e-70a96f8203bd]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWGCEDIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23830656433393731', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830656433393731', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.033s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:17 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:17 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c2b243-cd72-4a02-8ec3-72b6af4a9bf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:58:17 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsLuUcMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:17 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b006d606-5fc8-435a-8992-06325c48cd0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9] added
Apr 14 11:58:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0ea87-39b0-4eec-8974-e92e20d12415]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[307ee422-afac-423f-95a3-f1af30a5cc48]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CQBTWbrM {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CQBTWbrM" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6eedc3-f6d0-4a1c-90a7-f5a3e548cf7c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CQBTWbrM'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5323efbb-6a5e-40d5-bf25-44f45b5567ad]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b807b35-fdb6-4aad-ba93-bdf9214cf806]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea5fa85-f523-4b1a-a786-9a3ba56abf08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9, portal: 172.16.0.220,3260]
Apr 14 11:58:17 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9, portal: 172.16.0.220,3260] successful.
Apr 14 11:58:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea020ca-93a3-4d3f-abe8-3c08847c45b6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5754f5ab-92a0-4bb6-8a86-8b5d1f4ac13d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:17 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:17 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[03896731-4d49-4ca2-b078-993b4907c9c1]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQBTWbrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:58:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] <== connect_volume: return (2484ms) {'type': 'block', 'scsi_wwn': '26536333931303765', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536333931303765', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.248s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:18 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:18 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede6d24b-c9d6-4d79-b5f6-1d961a539530]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:58:18 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmIpGdRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:18 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc393a24-4d9d-4053-9275-662c54e384df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b] added
Apr 14 11:58:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9321ebf-4165-40f7-9933-6f3b3109cfc8]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a93ea2-00e1-4bd1-ade6-637d99d43477]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsLuUcMq {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsLuUcMq" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80aa375-ff31-4915-b0dd-ce883a122f8c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HsLuUcMq'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d493ee84-ceaf-4b81-bdd7-b79b363089c1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f4e10b-a73b-4793-8d97-cc5cfb926aff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:18 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:18 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e90e89f-69af-4bdf-851f-8ffd1ad9a957]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b, portal: 172.16.0.220,3260]
Apr 14 11:58:18 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b, portal: 172.16.0.220,3260] successful.
Apr 14 11:58:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff04a308-4022-4d7a-9896-a4cb473b6464]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe478a8e-f589-400d-a7fa-138fad2ffa41]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:18 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:18 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:18 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:18 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce60091-2278-4cc6-a7d7-f9dabec243d7]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsLuUcMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] <== connect_volume: return (2561ms) {'type': 'block', 'scsi_wwn': '23362643766303061', 'path': '/dev/sdd'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362643766303061', 'path': '/dev/sdd'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.278s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:19 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:19 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c529db-0ddc-459d-94a3-7c0deb14321d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:58:19 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHvwcBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:19 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e00110-9fb5-423a-b1f1-30499e1eee91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f] added
Apr 14 11:58:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4c8e5f-931f-4786-9df8-125bf8ffdfd8]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b94903b-3886-46d1-912e-1b8fa71de079]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmIpGdRL {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmIpGdRL" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[607e597c-5919-4417-8e5f-274a2cabe9bb]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QmIpGdRL'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1801bc5-12b1-4342-9218-c176e7957c27]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa139492-cee4-498a-ba4b-f9d28e01a78b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:19 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:19 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:19 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:19 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cd9eb5-a149-4662-9d64-93b32bdb77d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f, portal: 172.16.0.220,3260]
Apr 14 11:58:20 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f, portal: 172.16.0.220,3260] successful.
Apr 14 11:58:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2152ee65-d953-42df-97ca-e8c3319888c7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb33e91c-bf11-4970-8d86-4af5631d395d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:20 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:20 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:20 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:20 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:20 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:20 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d004e776-67d9-4620-849f-bab5dd2e16a7]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmIpGdRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] <== connect_volume: return (2594ms) {'type': 'block', 'scsi_wwn': '23632383336623666', 'path': '/dev/sde'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632383336623666', 'path': '/dev/sde'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.291s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:21 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:21 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf74b76-079a-4c8a-a306-8dc068d2f7f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:58:21 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYFfydbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:21 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d33bf-6c1a-4795-92ad-d76102d8c768]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb] added
Apr 14 11:58:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11bbe19-7899-4ebc-a331-b72b4232f91d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c2bd2f-b17a-485d-ad88-9fae63aad8d6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFHvwcBt {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFHvwcBt" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd30c24-4fcd-4c97-898c-ed57d8c43558]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFHvwcBt'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0821a7d4-4fb9-4a17-9ff8-d2878fad94db]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f73478-9221-4707-9bdd-04f3996ee425]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef0f6b6-0c86-432a-995d-c9cf1e92615d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb, portal: 172.16.0.220,3260]
Apr 14 11:58:21 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb, portal: 172.16.0.220,3260] successful.
Apr 14 11:58:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e53fd68-f79c-467c-9810-dd3ee908395a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[291ef97b-b732-4161-ac8e-4412d39497db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:21 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eedada-211f-4aa9-809f-1a9b44fad52b]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHvwcBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] <== connect_volume: return (2615ms) {'type': 'block', 'scsi_wwn': '26263626131393339', 'path': '/dev/sdf'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263626131393339', 'path': '/dev/sdf'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.296s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:22 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:22 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a058fc0-16eb-486d-bc91-783b668127c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:58:22 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d5d801-dd35-489c-a812-a65ef55932fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938] added
Apr 14 11:58:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd0838f-51d6-42b4-8831-9f29d6cde08d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:07:33,bridge_name='br-int',has_traffic_filtering=True,id=6ea5022d-9892-4cd9-90a9-4328326b209d,network=Network(8efae657-134b-4684-b335-14ca3539ebe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea5022d-98') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:00,bridge_name='br-int',has_traffic_filtering=True,id=314dd23d-4b31-40a2-9a19-37613754a61b,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap314dd23d-4b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4d:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ee869ed-353a-4e35-b0d9-57f8441c91ff,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ee869ed-35') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:02:37,bridge_name='br-int',has_traffic_filtering=True,id=b786ac42-d885-4cbb-a03c-5d7c17adfae2,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb786ac42-d8') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:a3,bridge_name='br-int',has_traffic_filtering=True,id=1dc3ed86-ee69-4541-a687-409bb40f1966,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc3ed86-ee') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:9d:c5,bridge_name='br-int',has_traffic_filtering=True,id=27a86908-d21f-46e8-a84d-66b055203f9b,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a86908-d2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=737a9bf4-c102-475e-b791-c56b01f23d0d,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a9bf4-c1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lazy-loading 'pci_devices' on Instance uuid b97d3633-4864-45fa-8d87-968507e13639 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bfd598-9012-41cc-b4ba-c478e032a8cd]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYFfydbX {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:58:22 user nova-compute[71330]:   <uuid>b97d3633-4864-45fa-8d87-968507e13639</uuid>
Apr 14 11:58:22 user nova-compute[71330]:   <name>instance-0000000b</name>
Apr 14 11:58:22 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:58:22 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:58:22 user nova-compute[71330]:   <metadata>
Apr 14 11:58:22 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:58:22 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:58:22 user nova-compute[71330]:       <nova:name>tempest-device-tagging-server-1172436186</nova:name>
Apr 14 11:58:22 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:58:15</nova:creationTime>
Apr 14 11:58:22 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:58:22 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:58:22 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:58:22 user nova-compute[71330]:       <nova:owner>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:user uuid="07e15f00ba92432e9c4a222e1b40c9ab">tempest-TaggedBootDevicesTest_v242-1593181551-project-member</nova:user>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:project uuid="01aedc5467e84f3788269d2f35ff4cb0">tempest-TaggedBootDevicesTest_v242-1593181551</nova:project>
Apr 14 11:58:22 user nova-compute[71330]:       </nova:owner>
Apr 14 11:58:22 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:58:22 user nova-compute[71330]:       <nova:ports>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:port uuid="6ea5022d-9892-4cd9-90a9-4328326b209d">
Apr 14 11:58:22 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 11:58:22 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:port uuid="314dd23d-4b31-40a2-9a19-37613754a61b">
Apr 14 11:58:22 user nova-compute[71330]:           <nova:ip type="fixed" address="10.1.1.217" ipVersion="4"/>
Apr 14 11:58:22 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:port uuid="3ee869ed-353a-4e35-b0d9-57f8441c91ff">
Apr 14 11:58:22 user nova-compute[71330]:           <nova:ip type="fixed" address="10.1.1.6" ipVersion="4"/>
Apr 14 11:58:22 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:port uuid="b786ac42-d885-4cbb-a03c-5d7c17adfae2">
Apr 14 11:58:22 user nova-compute[71330]:           <nova:ip type="fixed" address="10.1.1.253" ipVersion="4"/>
Apr 14 11:58:22 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:port uuid="1dc3ed86-ee69-4541-a687-409bb40f1966">
Apr 14 11:58:22 user nova-compute[71330]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Apr 14 11:58:22 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:port uuid="27a86908-d21f-46e8-a84d-66b055203f9b">
Apr 14 11:58:22 user nova-compute[71330]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 11:58:22 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:22 user nova-compute[71330]:         <nova:port uuid="737a9bf4-c102-475e-b791-c56b01f23d0d">
Apr 14 11:58:22 user nova-compute[71330]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 11:58:22 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:22 user nova-compute[71330]:       </nova:ports>
Apr 14 11:58:22 user nova-compute[71330]:     </nova:instance>
Apr 14 11:58:22 user nova-compute[71330]:   </metadata>
Apr 14 11:58:22 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:58:22 user nova-compute[71330]:     <system>
Apr 14 11:58:22 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:58:22 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:58:22 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:58:22 user nova-compute[71330]:       <entry name="serial">b97d3633-4864-45fa-8d87-968507e13639</entry>
Apr 14 11:58:22 user nova-compute[71330]:       <entry name="uuid">b97d3633-4864-45fa-8d87-968507e13639</entry>
Apr 14 11:58:22 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:58:22 user nova-compute[71330]:     </system>
Apr 14 11:58:22 user nova-compute[71330]:   </sysinfo>
Apr 14 11:58:22 user nova-compute[71330]:   <os>
Apr 14 11:58:22 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:58:22 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:58:22 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:58:22 user nova-compute[71330]:   </os>
Apr 14 11:58:22 user nova-compute[71330]:   <features>
Apr 14 11:58:22 user nova-compute[71330]:     <acpi/>
Apr 14 11:58:22 user nova-compute[71330]:     <apic/>
Apr 14 11:58:22 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:58:22 user nova-compute[71330]:   </features>
Apr 14 11:58:22 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:58:22 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:58:22 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:58:22 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:58:22 user nova-compute[71330]:   </clock>
Apr 14 11:58:22 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:58:22 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:58:22 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:58:22 user nova-compute[71330]:   </cpu>
Apr 14 11:58:22 user nova-compute[71330]:   <devices>
Apr 14 11:58:22 user nova-compute[71330]:     <disk type="file" device="cdrom">
Apr 14 11:58:22 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 11:58:22 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/b97d3633-4864-45fa-8d87-968507e13639/disk.config"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="hda" bus="ide"/>
Apr 14 11:58:22 user nova-compute[71330]:     </disk>
Apr 14 11:58:22 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 11:58:22 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:58:22 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <serial>a4b6d7b7-aee4-4c93-8b51-fe6da314cb89</serial>
Apr 14 11:58:22 user nova-compute[71330]:     </disk>
Apr 14 11:58:22 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 11:58:22 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:58:22 user nova-compute[71330]:       <source dev="/dev/sdd"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <serial>fb07ad60-62ba-467a-87a2-abe53abda98b</serial>
Apr 14 11:58:22 user nova-compute[71330]:     </disk>
Apr 14 11:58:22 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 11:58:22 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:58:22 user nova-compute[71330]:       <source dev="/dev/sdf"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="vdc" bus="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <serial>84ffdf09-b386-4f7b-956b-087ab6d671eb</serial>
Apr 14 11:58:22 user nova-compute[71330]:     </disk>
Apr 14 11:58:22 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:22 user nova-compute[71330]:       <mac address="fa:16:3e:60:07:33"/>
Apr 14 11:58:22 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="tap6ea5022d-98"/>
Apr 14 11:58:22 user nova-compute[71330]:     </interface>
Apr 14 11:58:22 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:22 user nova-compute[71330]:       <mac address="fa:16:3e:39:62:00"/>
Apr 14 11:58:22 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="tap314dd23d-4b"/>
Apr 14 11:58:22 user nova-compute[71330]:     </interface>
Apr 14 11:58:22 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:22 user nova-compute[71330]:       <mac address="fa:16:3e:24:4d:1d"/>
Apr 14 11:58:22 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="tap3ee869ed-35"/>
Apr 14 11:58:22 user nova-compute[71330]:     </interface>
Apr 14 11:58:22 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:22 user nova-compute[71330]:       <mac address="fa:16:3e:24:02:37"/>
Apr 14 11:58:22 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="tapb786ac42-d8"/>
Apr 14 11:58:22 user nova-compute[71330]:     </interface>
Apr 14 11:58:22 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:22 user nova-compute[71330]:       <mac address="fa:16:3e:8c:13:a3"/>
Apr 14 11:58:22 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="tap1dc3ed86-ee"/>
Apr 14 11:58:22 user nova-compute[71330]:     </interface>
Apr 14 11:58:22 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:22 user nova-compute[71330]:       <mac address="fa:16:3e:be:9d:c5"/>
Apr 14 11:58:22 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="tap27a86908-d2"/>
Apr 14 11:58:22 user nova-compute[71330]:     </interface>
Apr 14 11:58:22 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:22 user nova-compute[71330]:       <mac address="fa:16:3e:d0:1f:cf"/>
Apr 14 11:58:22 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:22 user nova-compute[71330]:       <target dev="tap737a9bf4-c1"/>
Apr 14 11:58:22 user nova-compute[71330]:     </interface>
Apr 14 11:58:22 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:58:22 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/b97d3633-4864-45fa-8d87-968507e13639/console.log" append="off"/>
Apr 14 11:58:22 user nova-compute[71330]:     </serial>
Apr 14 11:58:22 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:58:22 user nova-compute[71330]:     <video>
Apr 14 11:58:22 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:22 user nova-compute[71330]:     </video>
Apr 14 11:58:22 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:58:22 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:58:22 user nova-compute[71330]:     </rng>
Apr 14 11:58:22 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:58:22 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:58:22 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:58:22 user nova-compute[71330]:     </memballoon>
Apr 14 11:58:22 user nova-compute[71330]:   </devices>
Apr 14 11:58:22 user nova-compute[71330]: </domain>
Apr 14 11:58:22 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:07:33,bridge_name='br-int',has_traffic_filtering=True,id=6ea5022d-9892-4cd9-90a9-4328326b209d,network=Network(8efae657-134b-4684-b335-14ca3539ebe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea5022d-98') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:07:33,bridge_name='br-int',has_traffic_filtering=True,id=6ea5022d-9892-4cd9-90a9-4328326b209d,network=Network(8efae657-134b-4684-b335-14ca3539ebe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea5022d-98') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYFfydbX" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c9c951-573c-4db5-877a-aca490778b4b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYFfydbX'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ea5022d-98, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ea5022d-98, col_values=(('external_ids', {'iface-id': '6ea5022d-9892-4cd9-90a9-4328326b209d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:07:33', 'vm-uuid': 'b97d3633-4864-45fa-8d87-968507e13639'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: INFO os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:07:33,bridge_name='br-int',has_traffic_filtering=True,id=6ea5022d-9892-4cd9-90a9-4328326b209d,network=Network(8efae657-134b-4684-b335-14ca3539ebe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea5022d-98')
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:00,bridge_name='br-int',has_traffic_filtering=True,id=314dd23d-4b31-40a2-9a19-37613754a61b,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap314dd23d-4b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:00,bridge_name='br-int',has_traffic_filtering=True,id=314dd23d-4b31-40a2-9a19-37613754a61b,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap314dd23d-4b') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f406a1cb-bd37-44a3-ab71-449cf0490594]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap314dd23d-4b, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap314dd23d-4b, col_values=(('external_ids', {'iface-id': '314dd23d-4b31-40a2-9a19-37613754a61b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:62:00', 'vm-uuid': 'b97d3633-4864-45fa-8d87-968507e13639'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: INFO os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:00,bridge_name='br-int',has_traffic_filtering=True,id=314dd23d-4b31-40a2-9a19-37613754a61b,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap314dd23d-4b')
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4d:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ee869ed-353a-4e35-b0d9-57f8441c91ff,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ee869ed-35') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4d:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ee869ed-353a-4e35-b0d9-57f8441c91ff,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ee869ed-35') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecc7ec3-d86a-49e6-9763-e13589aff921]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ee869ed-35, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ee869ed-35, col_values=(('external_ids', {'iface-id': '3ee869ed-353a-4e35-b0d9-57f8441c91ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:4d:1d', 'vm-uuid': 'b97d3633-4864-45fa-8d87-968507e13639'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: INFO os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4d:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ee869ed-353a-4e35-b0d9-57f8441c91ff,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ee869ed-35')
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:02:37,bridge_name='br-int',has_traffic_filtering=True,id=b786ac42-d885-4cbb-a03c-5d7c17adfae2,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb786ac42-d8') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:02:37,bridge_name='br-int',has_traffic_filtering=True,id=b786ac42-d885-4cbb-a03c-5d7c17adfae2,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb786ac42-d8') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb786ac42-d8, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb786ac42-d8, col_values=(('external_ids', {'iface-id': 'b786ac42-d885-4cbb-a03c-5d7c17adfae2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:02:37', 'vm-uuid': 'b97d3633-4864-45fa-8d87-968507e13639'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fda2bb-9bba-4dfd-8ad1-3813092b2397]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938, portal: 172.16.0.220,3260]
Apr 14 11:58:22 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938, portal: 172.16.0.220,3260] successful.
Apr 14 11:58:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: INFO os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:02:37,bridge_name='br-int',has_traffic_filtering=True,id=b786ac42-d885-4cbb-a03c-5d7c17adfae2,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb786ac42-d8')
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:a3,bridge_name='br-int',has_traffic_filtering=True,id=1dc3ed86-ee69-4541-a687-409bb40f1966,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc3ed86-ee') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:a3,bridge_name='br-int',has_traffic_filtering=True,id=1dc3ed86-ee69-4541-a687-409bb40f1966,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc3ed86-ee') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dc3ed86-ee, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1dc3ed86-ee, col_values=(('external_ids', {'iface-id': '1dc3ed86-ee69-4541-a687-409bb40f1966', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:13:a3', 'vm-uuid': 'b97d3633-4864-45fa-8d87-968507e13639'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3d9590-7d5c-45f5-86d6-a858496179ea]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b6d663-ce10-4016-9318-017e4b9471a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:22 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:58:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: INFO os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:a3,bridge_name='br-int',has_traffic_filtering=True,id=1dc3ed86-ee69-4541-a687-409bb40f1966,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc3ed86-ee')
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:9d:c5,bridge_name='br-int',has_traffic_filtering=True,id=27a86908-d21f-46e8-a84d-66b055203f9b,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a86908-d2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9d:c5,bridge_name='br-int',has_traffic_filtering=True,id=27a86908-d21f-46e8-a84d-66b055203f9b,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a86908-d2') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e724433-0b35-4b04-bfb9-7085f46266f8]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27a86908-d2, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27a86908-d2, col_values=(('external_ids', {'iface-id': '27a86908-d21f-46e8-a84d-66b055203f9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:9d:c5', 'vm-uuid': 'b97d3633-4864-45fa-8d87-968507e13639'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: INFO os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9d:c5,bridge_name='br-int',has_traffic_filtering=True,id=27a86908-d21f-46e8-a84d-66b055203f9b,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a86908-d2')
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=737a9bf4-c102-475e-b791-c56b01f23d0d,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a9bf4-c1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=737a9bf4-c102-475e-b791-c56b01f23d0d,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a9bf4-c1') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap737a9bf4-c1, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap737a9bf4-c1, col_values=(('external_ids', {'iface-id': '737a9bf4-c102-475e-b791-c56b01f23d0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:1f:cf', 'vm-uuid': 'b97d3633-4864-45fa-8d87-968507e13639'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:22 user nova-compute[71330]: INFO os_vif [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=737a9bf4-c102-475e-b791-c56b01f23d0d,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a9bf4-c1')
Apr 14 11:58:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] No BDM found with device name hda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:58:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:58:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] No VIF found with MAC fa:16:3e:60:07:33, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:58:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] No VIF found with MAC fa:16:3e:8c:13:a3, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:58:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Using config drive
Apr 14 11:58:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Creating config drive at /opt/stack/data/nova/instances/b97d3633-4864-45fa-8d87-968507e13639/disk.config
Apr 14 11:58:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b97d3633-4864-45fa-8d87-968507e13639/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1wbvh4ld {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b97d3633-4864-45fa-8d87-968507e13639/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1wbvh4ld" returned: 0 in 0.055s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:23 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYFfydbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:58:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] <== connect_volume: return (2691ms) {'type': 'block', 'scsi_wwn': '26637646333653733', 'path': '/dev/sdg'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637646333653733', 'path': '/dev/sdg'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=e643b092-2a68-4a03-810c-74731525841b,network=Network(ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape643b092-2a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:20:b6,bridge_name='br-int',has_traffic_filtering=True,id=a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa78f67d0-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:3f:46,bridge_name='br-int',has_traffic_filtering=True,id=56378bcd-5459-47e7-8424-345fc574ebc7,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56378bcd-54') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=7fc577b9-cdea-45d8-9e73-a5cae3b67eec,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc577b9-cd') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:7a,bridge_name='br-int',has_traffic_filtering=True,id=18a26f8b-649d-4f0f-865f-cea6cd23372b,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a26f8b-64') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:35:02,bridge_name='br-int',has_traffic_filtering=True,id=9f35f7af-3587-48b6-9ee5-05dd1fdb00a4,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f35f7af-35') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab64dc7-8b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.objects.instance [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lazy-loading 'pci_devices' on Instance uuid 132e2ee3-a757-42ef-b0ae-3441dca65da5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:58:24 user nova-compute[71330]:   <uuid>132e2ee3-a757-42ef-b0ae-3441dca65da5</uuid>
Apr 14 11:58:24 user nova-compute[71330]:   <name>instance-0000000c</name>
Apr 14 11:58:24 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:58:24 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:58:24 user nova-compute[71330]:   <metadata>
Apr 14 11:58:24 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:58:24 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:58:24 user nova-compute[71330]:       <nova:name>tempest-device-tagging-server-508386442</nova:name>
Apr 14 11:58:24 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:58:15</nova:creationTime>
Apr 14 11:58:24 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:58:24 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:58:24 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:58:24 user nova-compute[71330]:       <nova:owner>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:user uuid="e0497d49f8544fe6b28101364faaadd7">tempest-TaggedBootDevicesTest-1490636318-project-member</nova:user>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:project uuid="62161098b7244829bdeba1cfd1d6b970">tempest-TaggedBootDevicesTest-1490636318</nova:project>
Apr 14 11:58:24 user nova-compute[71330]:       </nova:owner>
Apr 14 11:58:24 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:58:24 user nova-compute[71330]:       <nova:ports>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:port uuid="e643b092-2a68-4a03-810c-74731525841b">
Apr 14 11:58:24 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 11:58:24 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:port uuid="a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79">
Apr 14 11:58:24 user nova-compute[71330]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Apr 14 11:58:24 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:port uuid="56378bcd-5459-47e7-8424-345fc574ebc7">
Apr 14 11:58:24 user nova-compute[71330]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Apr 14 11:58:24 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:port uuid="7fc577b9-cdea-45d8-9e73-a5cae3b67eec">
Apr 14 11:58:24 user nova-compute[71330]:           <nova:ip type="fixed" address="10.1.1.246" ipVersion="4"/>
Apr 14 11:58:24 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:port uuid="18a26f8b-649d-4f0f-865f-cea6cd23372b">
Apr 14 11:58:24 user nova-compute[71330]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Apr 14 11:58:24 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:port uuid="9f35f7af-3587-48b6-9ee5-05dd1fdb00a4">
Apr 14 11:58:24 user nova-compute[71330]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 11:58:24 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:24 user nova-compute[71330]:         <nova:port uuid="8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab">
Apr 14 11:58:24 user nova-compute[71330]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 11:58:24 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:24 user nova-compute[71330]:       </nova:ports>
Apr 14 11:58:24 user nova-compute[71330]:     </nova:instance>
Apr 14 11:58:24 user nova-compute[71330]:   </metadata>
Apr 14 11:58:24 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:58:24 user nova-compute[71330]:     <system>
Apr 14 11:58:24 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:58:24 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:58:24 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:58:24 user nova-compute[71330]:       <entry name="serial">132e2ee3-a757-42ef-b0ae-3441dca65da5</entry>
Apr 14 11:58:24 user nova-compute[71330]:       <entry name="uuid">132e2ee3-a757-42ef-b0ae-3441dca65da5</entry>
Apr 14 11:58:24 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:58:24 user nova-compute[71330]:     </system>
Apr 14 11:58:24 user nova-compute[71330]:   </sysinfo>
Apr 14 11:58:24 user nova-compute[71330]:   <os>
Apr 14 11:58:24 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:58:24 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 11:58:24 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:58:24 user nova-compute[71330]:   </os>
Apr 14 11:58:24 user nova-compute[71330]:   <features>
Apr 14 11:58:24 user nova-compute[71330]:     <acpi/>
Apr 14 11:58:24 user nova-compute[71330]:     <apic/>
Apr 14 11:58:24 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:58:24 user nova-compute[71330]:   </features>
Apr 14 11:58:24 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:58:24 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:58:24 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:58:24 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:58:24 user nova-compute[71330]:   </clock>
Apr 14 11:58:24 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:58:24 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:58:24 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:58:24 user nova-compute[71330]:   </cpu>
Apr 14 11:58:24 user nova-compute[71330]:   <devices>
Apr 14 11:58:24 user nova-compute[71330]:     <disk type="file" device="cdrom">
Apr 14 11:58:24 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 11:58:24 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/132e2ee3-a757-42ef-b0ae-3441dca65da5/disk.config"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="hda" bus="ide"/>
Apr 14 11:58:24 user nova-compute[71330]:     </disk>
Apr 14 11:58:24 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 11:58:24 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:58:24 user nova-compute[71330]:       <source dev="/dev/sdc"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <serial>895ab6a9-dbf3-4601-a05b-a462b92efde9</serial>
Apr 14 11:58:24 user nova-compute[71330]:     </disk>
Apr 14 11:58:24 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 11:58:24 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:58:24 user nova-compute[71330]:       <source dev="/dev/sde"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <serial>a8da01ce-a845-488b-8e7d-049d79697c6f</serial>
Apr 14 11:58:24 user nova-compute[71330]:     </disk>
Apr 14 11:58:24 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 11:58:24 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:58:24 user nova-compute[71330]:       <source dev="/dev/sdg"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="vdc" bus="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <serial>dda8c2c2-a10a-40f4-99f7-8b65ac91d938</serial>
Apr 14 11:58:24 user nova-compute[71330]:     </disk>
Apr 14 11:58:24 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:24 user nova-compute[71330]:       <mac address="fa:16:3e:85:b4:b9"/>
Apr 14 11:58:24 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="tape643b092-2a"/>
Apr 14 11:58:24 user nova-compute[71330]:     </interface>
Apr 14 11:58:24 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:24 user nova-compute[71330]:       <mac address="fa:16:3e:aa:20:b6"/>
Apr 14 11:58:24 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="tapa78f67d0-ec"/>
Apr 14 11:58:24 user nova-compute[71330]:     </interface>
Apr 14 11:58:24 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:24 user nova-compute[71330]:       <mac address="fa:16:3e:18:3f:46"/>
Apr 14 11:58:24 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="tap56378bcd-54"/>
Apr 14 11:58:24 user nova-compute[71330]:     </interface>
Apr 14 11:58:24 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:24 user nova-compute[71330]:       <mac address="fa:16:3e:cf:ae:7e"/>
Apr 14 11:58:24 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="tap7fc577b9-cd"/>
Apr 14 11:58:24 user nova-compute[71330]:     </interface>
Apr 14 11:58:24 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:24 user nova-compute[71330]:       <mac address="fa:16:3e:d4:ad:7a"/>
Apr 14 11:58:24 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="tap18a26f8b-64"/>
Apr 14 11:58:24 user nova-compute[71330]:     </interface>
Apr 14 11:58:24 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:24 user nova-compute[71330]:       <mac address="fa:16:3e:fc:35:02"/>
Apr 14 11:58:24 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="tap9f35f7af-35"/>
Apr 14 11:58:24 user nova-compute[71330]:     </interface>
Apr 14 11:58:24 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:24 user nova-compute[71330]:       <mac address="fa:16:3e:f4:e3:2c"/>
Apr 14 11:58:24 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:24 user nova-compute[71330]:       <target dev="tap8ab64dc7-8b"/>
Apr 14 11:58:24 user nova-compute[71330]:     </interface>
Apr 14 11:58:24 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:58:24 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/132e2ee3-a757-42ef-b0ae-3441dca65da5/console.log" append="off"/>
Apr 14 11:58:24 user nova-compute[71330]:     </serial>
Apr 14 11:58:24 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:58:24 user nova-compute[71330]:     <video>
Apr 14 11:58:24 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:24 user nova-compute[71330]:     </video>
Apr 14 11:58:24 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:58:24 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:58:24 user nova-compute[71330]:     </rng>
Apr 14 11:58:24 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:58:24 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:58:24 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:58:24 user nova-compute[71330]:     </memballoon>
Apr 14 11:58:24 user nova-compute[71330]:   </devices>
Apr 14 11:58:24 user nova-compute[71330]: </domain>
Apr 14 11:58:24 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=e643b092-2a68-4a03-810c-74731525841b,network=Network(ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape643b092-2a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=e643b092-2a68-4a03-810c-74731525841b,network=Network(ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape643b092-2a') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape643b092-2a, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape643b092-2a, col_values=(('external_ids', {'iface-id': 'e643b092-2a68-4a03-810c-74731525841b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:b4:b9', 'vm-uuid': '132e2ee3-a757-42ef-b0ae-3441dca65da5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: INFO os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=e643b092-2a68-4a03-810c-74731525841b,network=Network(ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape643b092-2a')
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:20:b6,bridge_name='br-int',has_traffic_filtering=True,id=a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa78f67d0-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:20:b6,bridge_name='br-int',has_traffic_filtering=True,id=a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa78f67d0-ec') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa78f67d0-ec, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa78f67d0-ec, col_values=(('external_ids', {'iface-id': 'a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:20:b6', 'vm-uuid': '132e2ee3-a757-42ef-b0ae-3441dca65da5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: INFO os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:20:b6,bridge_name='br-int',has_traffic_filtering=True,id=a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa78f67d0-ec')
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:3f:46,bridge_name='br-int',has_traffic_filtering=True,id=56378bcd-5459-47e7-8424-345fc574ebc7,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56378bcd-54') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:3f:46,bridge_name='br-int',has_traffic_filtering=True,id=56378bcd-5459-47e7-8424-345fc574ebc7,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56378bcd-54') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56378bcd-54, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56378bcd-54, col_values=(('external_ids', {'iface-id': '56378bcd-5459-47e7-8424-345fc574ebc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:3f:46', 'vm-uuid': '132e2ee3-a757-42ef-b0ae-3441dca65da5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: INFO os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:3f:46,bridge_name='br-int',has_traffic_filtering=True,id=56378bcd-5459-47e7-8424-345fc574ebc7,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56378bcd-54')
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=7fc577b9-cdea-45d8-9e73-a5cae3b67eec,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc577b9-cd') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=7fc577b9-cdea-45d8-9e73-a5cae3b67eec,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc577b9-cd') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fc577b9-cd, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7fc577b9-cd, col_values=(('external_ids', {'iface-id': '7fc577b9-cdea-45d8-9e73-a5cae3b67eec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:ae:7e', 'vm-uuid': '132e2ee3-a757-42ef-b0ae-3441dca65da5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: INFO os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=7fc577b9-cdea-45d8-9e73-a5cae3b67eec,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc577b9-cd')
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:7a,bridge_name='br-int',has_traffic_filtering=True,id=18a26f8b-649d-4f0f-865f-cea6cd23372b,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a26f8b-64') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:7a,bridge_name='br-int',has_traffic_filtering=True,id=18a26f8b-649d-4f0f-865f-cea6cd23372b,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a26f8b-64') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18a26f8b-64, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18a26f8b-64, col_values=(('external_ids', {'iface-id': '18a26f8b-649d-4f0f-865f-cea6cd23372b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:ad:7a', 'vm-uuid': '132e2ee3-a757-42ef-b0ae-3441dca65da5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.compute.manager [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.compute.manager [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:25 user nova-compute[71330]: WARNING nova.compute.manager [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-6ea5022d-9892-4cd9-90a9-4328326b209d for instance with vm_state building and task_state spawning.
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: INFO os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:7a,bridge_name='br-int',has_traffic_filtering=True,id=18a26f8b-649d-4f0f-865f-cea6cd23372b,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a26f8b-64')
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:35:02,bridge_name='br-int',has_traffic_filtering=True,id=9f35f7af-3587-48b6-9ee5-05dd1fdb00a4,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f35f7af-35') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:35:02,bridge_name='br-int',has_traffic_filtering=True,id=9f35f7af-3587-48b6-9ee5-05dd1fdb00a4,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f35f7af-35') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f35f7af-35, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f35f7af-35, col_values=(('external_ids', {'iface-id': '9f35f7af-3587-48b6-9ee5-05dd1fdb00a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:35:02', 'vm-uuid': '132e2ee3-a757-42ef-b0ae-3441dca65da5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: INFO os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:35:02,bridge_name='br-int',has_traffic_filtering=True,id=9f35f7af-3587-48b6-9ee5-05dd1fdb00a4,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f35f7af-35')
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab64dc7-8b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab64dc7-8b') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ab64dc7-8b, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ab64dc7-8b, col_values=(('external_ids', {'iface-id': '8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:e3:2c', 'vm-uuid': '132e2ee3-a757-42ef-b0ae-3441dca65da5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: INFO os_vif [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab64dc7-8b')
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] No BDM found with device name hda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] No VIF found with MAC fa:16:3e:85:b4:b9, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] No VIF found with MAC fa:16:3e:d4:ad:7a, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:58:25 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Using config drive
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:26 user nova-compute[71330]: WARNING nova.compute.manager [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance with vm_state building and task_state spawning.
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Creating config drive at /opt/stack/data/nova/instances/132e2ee3-a757-42ef-b0ae-3441dca65da5/disk.config
Apr 14 11:58:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/132e2ee3-a757-42ef-b0ae-3441dca65da5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpesurbfdb {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/132e2ee3-a757-42ef-b0ae-3441dca65da5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpesurbfdb" returned: 0 in 0.060s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:26 user nova-compute[71330]: WARNING nova.compute.manager [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-1dc3ed86-ee69-4541-a687-409bb40f1966 for instance with vm_state building and task_state spawning.
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:27 user nova-compute[71330]: WARNING nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-6ea5022d-9892-4cd9-90a9-4328326b209d for instance with vm_state building and task_state spawning.
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:27 user nova-compute[71330]: WARNING nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-314dd23d-4b31-40a2-9a19-37613754a61b for instance with vm_state building and task_state spawning.
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:27 user nova-compute[71330]: WARNING nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-314dd23d-4b31-40a2-9a19-37613754a61b for instance with vm_state building and task_state spawning.
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:27 user nova-compute[71330]: WARNING nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff for instance with vm_state building and task_state spawning.
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:27 user nova-compute[71330]: WARNING nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff for instance with vm_state building and task_state spawning.
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:27 user nova-compute[71330]: WARNING nova.compute.manager [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-27a86908-d21f-46e8-a84d-66b055203f9b for instance with vm_state building and task_state spawning.
Apr 14 11:58:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:28 user nova-compute[71330]: WARNING nova.compute.manager [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-1dc3ed86-ee69-4541-a687-409bb40f1966 for instance with vm_state building and task_state spawning.
Apr 14 11:58:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:28 user nova-compute[71330]: WARNING nova.compute.manager [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-737a9bf4-c102-475e-b791-c56b01f23d0d for instance with vm_state building and task_state spawning.
Apr 14 11:58:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:28 user nova-compute[71330]: WARNING nova.compute.manager [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-737a9bf4-c102-475e-b791-c56b01f23d0d for instance with vm_state building and task_state spawning.
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:28 user nova-compute[71330]: WARNING nova.compute.manager [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance with vm_state building and task_state spawning.
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:29 user nova-compute[71330]: WARNING nova.compute.manager [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-27a86908-d21f-46e8-a84d-66b055203f9b for instance with vm_state building and task_state spawning.
Apr 14 11:58:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:29 user nova-compute[71330]: WARNING nova.compute.manager [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 for instance with vm_state building and task_state spawning.
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:30 user nova-compute[71330]: WARNING nova.compute.manager [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-e643b092-2a68-4a03-810c-74731525841b for instance with vm_state building and task_state spawning.
Apr 14 11:58:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:30 user nova-compute[71330]: WARNING nova.compute.manager [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-e643b092-2a68-4a03-810c-74731525841b for instance with vm_state building and task_state spawning.
Apr 14 11:58:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:30 user nova-compute[71330]: WARNING nova.compute.manager [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance with vm_state building and task_state spawning.
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473511.0054965, b97d3633-4864-45fa-8d87-968507e13639 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:58:31 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b97d3633-4864-45fa-8d87-968507e13639] VM Resumed (Lifecycle Event)
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:58:31 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance spawned successfully.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b97d3633-4864-45fa-8d87-968507e13639] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b97d3633-4864-45fa-8d87-968507e13639] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:31 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b97d3633-4864-45fa-8d87-968507e13639] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473511.0072508, b97d3633-4864-45fa-8d87-968507e13639 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:58:31 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b97d3633-4864-45fa-8d87-968507e13639] VM Started (Lifecycle Event)
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b97d3633-4864-45fa-8d87-968507e13639] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b97d3633-4864-45fa-8d87-968507e13639] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:58:31 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b97d3633-4864-45fa-8d87-968507e13639] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:31 user nova-compute[71330]: INFO nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Took 15.54 seconds to spawn the instance on the hypervisor.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:31 user nova-compute[71330]: INFO nova.compute.manager [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Took 34.83 seconds to build instance.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "b97d3633-4864-45fa-8d87-968507e13639" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.098s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:31 user nova-compute[71330]: WARNING nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 for instance with vm_state building and task_state spawning.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:31 user nova-compute[71330]: WARNING nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-56378bcd-5459-47e7-8424-345fc574ebc7 for instance with vm_state building and task_state spawning.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:31 user nova-compute[71330]: WARNING nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-56378bcd-5459-47e7-8424-345fc574ebc7 for instance with vm_state building and task_state spawning.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:31 user nova-compute[71330]: WARNING nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance with vm_state building and task_state spawning.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:31 user nova-compute[71330]: WARNING nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance with vm_state building and task_state spawning.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:31 user nova-compute[71330]: WARNING nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-18a26f8b-649d-4f0f-865f-cea6cd23372b for instance with vm_state building and task_state spawning.
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:31 user nova-compute[71330]: WARNING nova.compute.manager [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-18a26f8b-649d-4f0f-865f-cea6cd23372b for instance with vm_state building and task_state spawning.
Apr 14 11:58:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:32 user nova-compute[71330]: WARNING nova.compute.manager [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance with vm_state building and task_state spawning.
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:32 user nova-compute[71330]: WARNING nova.compute.manager [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance with vm_state building and task_state spawning.
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:32 user nova-compute[71330]: WARNING nova.compute.manager [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance with vm_state building and task_state spawning.
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473512.5991898, 132e2ee3-a757-42ef-b0ae-3441dca65da5 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:58:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] VM Resumed (Lifecycle Event)
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:58:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance spawned successfully.
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:58:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473512.60062, 132e2ee3-a757-42ef-b0ae-3441dca65da5 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:58:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] VM Started (Lifecycle Event)
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:58:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:58:32 user nova-compute[71330]: INFO nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Took 16.78 seconds to spawn the instance on the hypervisor.
Apr 14 11:58:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:32 user nova-compute[71330]: INFO nova.compute.manager [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Took 34.68 seconds to build instance.
Apr 14 11:58:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.803s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:42 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:42 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:42 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:58:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-252824ed-0978-4f05-b03e-4d92057ce3ad" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-252824ed-0978-4f05-b03e-4d92057ce3ad" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:42 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Updating instance_info_cache with network_info: [{"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-252824ed-0978-4f05-b03e-4d92057ce3ad" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:58:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:45 user nova-compute[71330]: INFO nova.compute.manager [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Rescuing
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquired lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG nova.network.neutron [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updating instance_info_cache with network_info: [{"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Releasing lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-unplugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] No waiting events found dispatching network-vif-unplugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:46 user nova-compute[71330]: WARNING nova.compute.manager [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received unexpected event network-vif-unplugged-e5175890-c267-454b-b532-70223beb1f72 for instance with vm_state active and task_state rescuing.
Apr 14 11:58:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:47 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:58:47 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7196MB free_disk=26.53847885131836GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:47 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Instance destroyed successfully.
Apr 14 11:58:47 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Attempting rescue
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71330) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Instance directory exists: not creating {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 11:58:47 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Creating image(s)
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b97d3633-4864-45fa-8d87-968507e13639 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 252824ed-0978-4f05-b03e-4d92057ce3ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 25eda1c2-9b82-412f-b75d-358e87847a29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue" returned: 0 in 0.050s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'migration_context' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Start _get_guest_xml network_info=[{"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "vif_mac": "fa:16:3e:66:90:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'resources' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'numa_topology' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "252824ed-0978-4f05-b03e-4d92057ce3ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:47 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:58:47 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lazy-loading 'flavor' on Instance uuid 252824ed-0978-4f05-b03e-4d92057ce3ad {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1361327346',display_name='tempest-ServerRescueNegativeTestJSON-server-1361327346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1361327346',id=3,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-30rb8yo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:18Z,user_data=None,user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=68f7b119-b1c9-47ce-b325-5a4730aef707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "vif_mac": "fa:16:3e:66:90:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "vif_mac": "fa:16:3e:66:90:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:90:02,bridge_name='br-int',has_traffic_filtering=True,id=e5175890-c267-454b-b532-70223beb1f72,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5175890-c2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'pci_devices' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:58:47 user nova-compute[71330]:   <uuid>68f7b119-b1c9-47ce-b325-5a4730aef707</uuid>
Apr 14 11:58:47 user nova-compute[71330]:   <name>instance-00000003</name>
Apr 14 11:58:47 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 11:58:47 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 11:58:47 user nova-compute[71330]:   <metadata>
Apr 14 11:58:47 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:58:47 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 11:58:47 user nova-compute[71330]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1361327346</nova:name>
Apr 14 11:58:47 user nova-compute[71330]:       <nova:creationTime>2023-04-14 11:58:47</nova:creationTime>
Apr 14 11:58:47 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 11:58:47 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 11:58:47 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 11:58:47 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 11:58:47 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:58:47 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:58:47 user nova-compute[71330]:       </nova:flavor>
Apr 14 11:58:47 user nova-compute[71330]:       <nova:owner>
Apr 14 11:58:47 user nova-compute[71330]:         <nova:user uuid="263c47076ee94cfaaa34eff928a36fdd">tempest-ServerRescueNegativeTestJSON-896417797-project-member</nova:user>
Apr 14 11:58:47 user nova-compute[71330]:         <nova:project uuid="f042abdcef8f41488e8f4624c2f4970b">tempest-ServerRescueNegativeTestJSON-896417797</nova:project>
Apr 14 11:58:47 user nova-compute[71330]:       </nova:owner>
Apr 14 11:58:47 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 11:58:47 user nova-compute[71330]:       <nova:ports>
Apr 14 11:58:47 user nova-compute[71330]:         <nova:port uuid="e5175890-c267-454b-b532-70223beb1f72">
Apr 14 11:58:47 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 11:58:47 user nova-compute[71330]:         </nova:port>
Apr 14 11:58:47 user nova-compute[71330]:       </nova:ports>
Apr 14 11:58:47 user nova-compute[71330]:     </nova:instance>
Apr 14 11:58:47 user nova-compute[71330]:   </metadata>
Apr 14 11:58:47 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 11:58:47 user nova-compute[71330]:     <system>
Apr 14 11:58:47 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:58:47 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:58:47 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 11:58:47 user nova-compute[71330]:       <entry name="serial">68f7b119-b1c9-47ce-b325-5a4730aef707</entry>
Apr 14 11:58:47 user nova-compute[71330]:       <entry name="uuid">68f7b119-b1c9-47ce-b325-5a4730aef707</entry>
Apr 14 11:58:47 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:58:47 user nova-compute[71330]:     </system>
Apr 14 11:58:47 user nova-compute[71330]:   </sysinfo>
Apr 14 11:58:47 user nova-compute[71330]:   <os>
Apr 14 11:58:47 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:58:47 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 11:58:47 user nova-compute[71330]:   </os>
Apr 14 11:58:47 user nova-compute[71330]:   <features>
Apr 14 11:58:47 user nova-compute[71330]:     <acpi/>
Apr 14 11:58:47 user nova-compute[71330]:     <apic/>
Apr 14 11:58:47 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 11:58:47 user nova-compute[71330]:   </features>
Apr 14 11:58:47 user nova-compute[71330]:   <clock offset="utc">
Apr 14 11:58:47 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:58:47 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:58:47 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 11:58:47 user nova-compute[71330]:   </clock>
Apr 14 11:58:47 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 11:58:47 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 11:58:47 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:58:47 user nova-compute[71330]:   </cpu>
Apr 14 11:58:47 user nova-compute[71330]:   <devices>
Apr 14 11:58:47 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:58:47 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:58:47 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue"/>
Apr 14 11:58:47 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 11:58:47 user nova-compute[71330]:     </disk>
Apr 14 11:58:47 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 11:58:47 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:58:47 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk"/>
Apr 14 11:58:47 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 11:58:47 user nova-compute[71330]:     </disk>
Apr 14 11:58:47 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 11:58:47 user nova-compute[71330]:       <mac address="fa:16:3e:66:90:02"/>
Apr 14 11:58:47 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:47 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 11:58:47 user nova-compute[71330]:       <target dev="tape5175890-c2"/>
Apr 14 11:58:47 user nova-compute[71330]:     </interface>
Apr 14 11:58:47 user nova-compute[71330]:     <serial type="pty">
Apr 14 11:58:47 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/console.log" append="off"/>
Apr 14 11:58:47 user nova-compute[71330]:     </serial>
Apr 14 11:58:47 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:58:47 user nova-compute[71330]:     <video>
Apr 14 11:58:47 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 11:58:47 user nova-compute[71330]:     </video>
Apr 14 11:58:47 user nova-compute[71330]:     <rng model="virtio">
Apr 14 11:58:47 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:58:47 user nova-compute[71330]:     </rng>
Apr 14 11:58:47 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:58:47 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 11:58:47 user nova-compute[71330]:       <stats period="10"/>
Apr 14 11:58:47 user nova-compute[71330]:     </memballoon>
Apr 14 11:58:47 user nova-compute[71330]:   </devices>
Apr 14 11:58:47 user nova-compute[71330]: </domain>
Apr 14 11:58:47 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Instance destroyed successfully.
Apr 14 11:58:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No VIF found with MAC fa:16:3e:66:90:02, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "252824ed-0978-4f05-b03e-4d92057ce3ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:48 user nova-compute[71330]: INFO nova.compute.manager [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Attaching volume d03b5243-1e59-49c5-8bc5-54f0fb6bb52c to /dev/vdb
Apr 14 11:58:48 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG os_brick.utils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f6c3ee-1a82-4633-b736-34221620746c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bd3072-7dd2-4c14-b4fb-18a00111db43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[057ed9fd-a972-41fd-8abb-25a03175f2b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3179b0-963e-4e5e-8662-be76045a5798]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:58:48 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe3834c-1e6b-4499-be06-c8b4406f16a8]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG os_brick.utils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Updating existing volume attachment record: 21b3cf05-b578-4501-a92a-9ddb525bf945 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] No waiting events found dispatching network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:48 user nova-compute[71330]: WARNING nova.compute.manager [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received unexpected event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 for instance with vm_state active and task_state rescuing.
Apr 14 11:58:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] No waiting events found dispatching network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:50 user nova-compute[71330]: WARNING nova.compute.manager [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received unexpected event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 for instance with vm_state active and task_state rescuing.
Apr 14 11:58:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] No waiting events found dispatching network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:50 user nova-compute[71330]: WARNING nova.compute.manager [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received unexpected event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 for instance with vm_state active and task_state rescuing.
Apr 14 11:58:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-changed-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Refreshing instance network info cache due to event network-changed-7ea071f4-a31f-4eb6-b79b-971106d2c33e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] Acquiring lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] Acquired lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:51 user nova-compute[71330]: DEBUG nova.network.neutron [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Refreshing network info cache for port 7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:51 user nova-compute[71330]: DEBUG nova.network.neutron [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updated VIF entry in instance network info cache for port 7ea071f4-a31f-4eb6-b79b-971106d2c33e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:58:51 user nova-compute[71330]: DEBUG nova.network.neutron [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating instance_info_cache with network_info: [{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] Releasing lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 68f7b119-b1c9-47ce-b325-5a4730aef707 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 11:58:52 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473532.1721866, 68f7b119-b1c9-47ce-b325-5a4730aef707 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:58:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] VM Resumed (Lifecycle Event)
Apr 14 11:58:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:58:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 11:58:52 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473532.1767542, 68f7b119-b1c9-47ce-b325-5a4730aef707 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:58:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] VM Started (Lifecycle Event)
Apr 14 11:58:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:58:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 11:58:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-changed-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Refreshing instance network info cache due to event network-changed-00a245fe-c22c-48a0-9718-72e81d0ef026. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:58:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] Acquiring lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:58:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] Acquired lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:58:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Refreshing network info cache for port 00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:58:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updated VIF entry in instance network info cache for port 00a245fe-c22c-48a0-9718-72e81d0ef026. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:58:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating instance_info_cache with network_info: [{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:58:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] Releasing lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:54 user nova-compute[71330]: INFO nova.compute.manager [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] instance snapshotting
Apr 14 11:58:54 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Beginning live snapshot process
Apr 14 11:58:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:58:54 user nova-compute[71330]: INFO nova.compute.manager [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] instance snapshotting
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json -f qcow2 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Beginning live snapshot process
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json -f qcow2" returned: 0 in 0.162s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json -f qcow2 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzDuPotp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:54 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:54 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:54 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d18a16-075e-4e28-8091-9a648b537d9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:58:54 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0cd88f-0e36-4abd-ab4f-bb07740d0f2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c] added
Apr 14 11:58:54 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json -f qcow2 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1dd59b-da1e-480d-bd8d-40ab43714bd3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json -f qcow2" returned: 0 in 0.166s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db4a15b-bb90-48ef-83d8-adc0f0600a4f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzDuPotp {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzDuPotp" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef9f0f-41f5-46c2-9264-77f6fc24ac6e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mzDuPotp'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:54 user nova-compute[71330]: INFO nova.compute.manager [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Shelving
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebd8b0b-e503-4d81-a49f-6151b3326c3c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json -f qcow2" returned: 0 in 0.162s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json -f qcow2 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[535c9415-486f-43c6-9965-b07fc308c455]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:58:54 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:54 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:58:54 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.163s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvflg8_1f/d96d5b7131624b72b9d23d3c3af467b1.delta 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvflg8_1f/d96d5b7131624b72b9d23d3c3af467b1.delta 1073741824" returned: 0 in 0.114s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53dd2a2-e0ea-49fc-9d70-9144066e676d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:55 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c, portal: 172.16.0.220,3260]
Apr 14 11:58:55 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c, portal: 172.16.0.220,3260] successful.
Apr 14 11:58:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9150087-8e1f-4267-a6d1-fdd144834ab9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71330) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 11:58:55 user nova-compute[71330]: INFO nova.virt.libvirt.host [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] UEFI support detected
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[295e7ac0-6497-4a48-ac0b-726dd202b394]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c (non-flash)
Apr 14 11:58:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:58:55 user nova-compute[71330]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c (non-flash)
Apr 14 11:58:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.506s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43df41c-5ea0-4b6f-a756-d83c776a98d8]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzDuPotp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.164s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsfnmnwj1/e79e723f01254a6181fd1ce2ef269fa3.delta 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsfnmnwj1/e79e723f01254a6181fd1ce2ef269fa3.delta 1073741824" returned: 0 in 0.055s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:55 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 11:58:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-unplugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] No waiting events found dispatching network-vif-unplugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:55 user nova-compute[71330]: WARNING nova.compute.manager [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received unexpected event network-vif-unplugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance with vm_state active and task_state shelving.
Apr 14 11:58:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:58:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.568s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] <== connect_volume: return (1571ms) {'type': 'block', 'scsi_wwn': '23734626632313666', 'path': '/dev/sdh'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734626632313666', 'path': '/dev/sdh'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:58:56 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lazy-loading 'flavor' on Instance uuid 252824ed-0978-4f05-b03e-4d92057ce3ad {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:58:56 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:58:56 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 11:58:56 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:58:56 user nova-compute[71330]:   <serial>d03b5243-1e59-49c5-8bc5-54f0fb6bb52c</serial>
Apr 14 11:58:56 user nova-compute[71330]: </disk>
Apr 14 11:58:56 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:58:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:58:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 11:58:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:58:56 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:58:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvflg8_1f/d96d5b7131624b72b9d23d3c3af467b1.delta /opt/stack/data/nova/instances/snapshots/tmpvflg8_1f/d96d5b7131624b72b9d23d3c3af467b1 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance destroyed successfully.
Apr 14 11:58:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:58:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 11:58:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Beginning cold snapshot process
Apr 14 11:58:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] No waiting events found dispatching network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:57 user nova-compute[71330]: WARNING nova.compute.manager [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received unexpected event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance with vm_state active and task_state shelving.
Apr 14 11:58:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] No VIF found with MAC fa:16:3e:5b:56:7f, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvflg8_1f/d96d5b7131624b72b9d23d3c3af467b1.delta /opt/stack/data/nova/instances/snapshots/tmpvflg8_1f/d96d5b7131624b72b9d23d3c3af467b1" returned: 0 in 0.560s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Snapshot extracted, beginning image upload
Apr 14 11:58:57 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsfnmnwj1/e79e723f01254a6181fd1ce2ef269fa3.delta /opt/stack/data/nova/instances/snapshots/tmpsfnmnwj1/e79e723f01254a6181fd1ce2ef269fa3 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.489s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk /opt/stack/data/nova/instances/snapshots/tmp85gn428c/3da37b66aeb34f97b7cb14ce17515584 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsfnmnwj1/e79e723f01254a6181fd1ce2ef269fa3.delta /opt/stack/data/nova/instances/snapshots/tmpsfnmnwj1/e79e723f01254a6181fd1ce2ef269fa3" returned: 0 in 0.245s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Snapshot extracted, beginning image upload
Apr 14 11:58:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "252824ed-0978-4f05-b03e-4d92057ce3ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:58 user nova-compute[71330]: INFO nova.compute.manager [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Terminating instance
Apr 14 11:58:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk /opt/stack/data/nova/instances/snapshots/tmp85gn428c/3da37b66aeb34f97b7cb14ce17515584" returned: 0 in 0.514s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:58 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Snapshot extracted, beginning image upload
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received event network-vif-unplugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] Acquiring lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] No waiting events found dispatching network-vif-unplugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received event network-vif-unplugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:58:58 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Instance destroyed successfully.
Apr 14 11:58:58 user nova-compute[71330]: DEBUG nova.objects.instance [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lazy-loading 'resources' on Instance uuid 252824ed-0978-4f05-b03e-4d92057ce3ad {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-761931801',display_name='tempest-DeleteServersTestJSON-server-761931801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-761931801',id=2,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='186a8d3457b646fc9085e0aac2cfda5b',ramdisk_id='',reservation_id='r-7ikp1y6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-232033621',owner_user_name='tempest-DeleteServersTestJSON-232033621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:57:18Z,user_data=None,user_id='31358bf3202e4dcb85df7f64c9d3c1d0',uuid=252824ed-0978-4f05-b03e-4d92057ce3ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Converting VIF {"id": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "address": "fa:16:3e:5b:56:7f", "network": {"id": "66d44260-0266-499f-82fb-d7e5bee9fcf7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1502497516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "186a8d3457b646fc9085e0aac2cfda5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eabf8-1b", "ovs_interfaceid": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:56:7f,bridge_name='br-int',has_traffic_filtering=True,id=0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d,network=Network(66d44260-0266-499f-82fb-d7e5bee9fcf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eabf8-1b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG os_vif [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:56:7f,bridge_name='br-int',has_traffic_filtering=True,id=0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d,network=Network(66d44260-0266-499f-82fb-d7e5bee9fcf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eabf8-1b') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e9eabf8-1b, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:58:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:58 user nova-compute[71330]: INFO os_vif [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:56:7f,bridge_name='br-int',has_traffic_filtering=True,id=0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d,network=Network(66d44260-0266-499f-82fb-d7e5bee9fcf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eabf8-1b')
Apr 14 11:58:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzDuPotp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:58:59 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e0a074-b319-4dab-b22d-180d36e101e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:58:59 user nova-compute[71330]: No targets found.
Apr 14 11:58:59 user nova-compute[71330]: iSNS:
Apr 14 11:58:59 user nova-compute[71330]: No targets found.
Apr 14 11:58:59 user nova-compute[71330]: STATIC:
Apr 14 11:58:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b
Apr 14 11:58:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:58:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:58:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9
Apr 14 11:58:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:58:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:58:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:58:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:58:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:58:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89
Apr 14 11:58:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:58:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:58:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb
Apr 14 11:58:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:58:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:58:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:58:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:58:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:58:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c
Apr 14 11:58:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:58:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:58:59 user nova-compute[71330]: FIRMWARE:
Apr 14 11:58:59 user nova-compute[71330]: No targets found.
Apr 14 11:58:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:58:59 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:58:59 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c27a3e-0768-4f0f-a3c8-21984b5e74e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f512de-acb0-4bff-8082-ebf543ce4ef6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c (non-flash)
Apr 14 11:58:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:58:59 user nova-compute[71330]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c (non-flash)
Apr 14 11:58:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495d536a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c'): ({'sdh'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Removing single pathed devices sdh {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[633f6829-e9e5-428e-bd2c-80758e4dc90b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc5c974-d3a6-4346-b00d-09b92b1a96d7]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Flushing IO for device /dev/sdh {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9671ffed-0789-4e8f-8f10-d9dc0b20b8e2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cb1d16-5af2-49e0-84ed-c1cca31e7fd5]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cd0edf-97e5-4eea-aaf2-aa5eeb252a8e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aabb21-ea55-45e2-9487-b6518f6e71ff]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c, portal: 172.16.0.220,3260]
Apr 14 11:58:59 user nova-compute[71330]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c, portal: 172.16.0.220,3260] successful.
Apr 14 11:58:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03b5243-1e59-49c5-8bc5-54f0fb6bb52c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9054daf4-60e0-4af0-b77f-a920d8887ab1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] <== disconnect_volume: return (402ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:58:59 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Deleting instance files /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad_del
Apr 14 11:58:59 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Deletion of /opt/stack/data/nova/instances/252824ed-0978-4f05-b03e-4d92057ce3ad_del complete
Apr 14 11:58:59 user nova-compute[71330]: INFO nova.compute.manager [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 14 11:58:59 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:58:59 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:59:00 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Snapshot image upload complete
Apr 14 11:59:00 user nova-compute[71330]: INFO nova.compute.manager [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Took 6.16 seconds to snapshot the instance on the hypervisor.
Apr 14 11:59:00 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received event network-vif-deleted-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:00 user nova-compute[71330]: INFO nova.compute.manager [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Neutron deleted interface 0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d; detaching it from the instance and deleting it from the info cache
Apr 14 11:59:00 user nova-compute[71330]: DEBUG nova.network.neutron [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:00 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Took 0.84 seconds to deallocate network for instance.
Apr 14 11:59:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Detach interface failed, port_id=0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d, reason: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:59:00 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Snapshot image upload complete
Apr 14 11:59:00 user nova-compute[71330]: INFO nova.compute.manager [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Took 6.08 seconds to snapshot the instance on the hypervisor.
Apr 14 11:59:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received event network-vif-plugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] Acquiring lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] No waiting events found dispatching network-vif-plugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:00 user nova-compute[71330]: WARNING nova.compute.manager [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Received unexpected event network-vif-plugged-0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance with vm_state active and task_state deleting.
Apr 14 11:59:01 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Snapshot image upload complete
Apr 14 11:59:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:59:01 user nova-compute[71330]: INFO nova.compute.manager [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Shelve offloading
Apr 14 11:59:01 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance destroyed successfully.
Apr 14 11:59:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:59:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:59:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquired lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:59:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:59:01 user nova-compute[71330]: INFO nova.compute.manager [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Took 0.89 seconds to detach 1 volumes for instance.
Apr 14 11:59:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating instance_info_cache with network_info: [{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Releasing lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:59:01 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:59:01 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:59:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:01 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Deleted allocations for instance 252824ed-0978-4f05-b03e-4d92057ce3ad
Apr 14 11:59:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "252824ed-0978-4f05-b03e-4d92057ce3ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.791s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:02 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance destroyed successfully.
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.objects.instance [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'resources' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373523786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373523786',id=4,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsyIPWrTgYx5mDYmYLAUYql9c5ytzflRJOI8xt+Liz9SO5uhpL9//IuWHW3+gSIh0I3JxFjHbVn4FDFn00auhiTq2XJaAhJLeaQLZujkXhytUWDHfKLlHryI1f/amUc4g==',key_name='tempest-keypair-1689899826',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-fmqjkid5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member',shelved_at='2023-04-14T11:59:01.057841',shelved_host='user',shelved_image_id='331e9706-c835-4968-9d4f-3f0a9a8400ac'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=ad7c2f89-c54f-4e78-b86d-88b4ab5daff4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG os_vif [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ea071f4-a3, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-changed-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Refreshing instance network info cache due to event network-changed-7ea071f4-a31f-4eb6-b79b-971106d2c33e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] Acquiring lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] Acquired lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Refreshing network info cache for port 7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:02 user nova-compute[71330]: INFO os_vif [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3')
Apr 14 11:59:02 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Deleting instance files /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4_del
Apr 14 11:59:02 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Deletion of /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4_del complete
Apr 14 11:59:02 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Deleted allocations for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4
Apr 14 11:59:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.objects.instance [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'numa_topology' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updated VIF entry in instance network info cache for port 7ea071f4-a31f-4eb6-b79b-971106d2c33e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating instance_info_cache with network_info: [{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] Releasing lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.173s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:12 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473537.3524613, ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:59:12 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] VM Stopped (Lifecycle Event)
Apr 14 11:59:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-795b2e4c-beb0-4f73-9c22-b22f2b11668c None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:59:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:13 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473538.931656, 252824ed-0978-4f05-b03e-4d92057ce3ad => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:59:13 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] VM Stopped (Lifecycle Event)
Apr 14 11:59:13 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ea6b1031-f10e-4cc9-899d-db0566afc3f4 None None] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:59:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received event network-changed-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Refreshing instance network info cache due to event network-changed-c9d9e100-59bd-4f58-8892-80c764c88b85. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:59:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] Acquiring lock "refresh_cache-47955121-a299-4b9b-aa83-0e55cfb52f4b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:59:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] Acquired lock "refresh_cache-47955121-a299-4b9b-aa83-0e55cfb52f4b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:59:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Refreshing network info cache for port c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:59:15 user nova-compute[71330]: DEBUG nova.network.neutron [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Updated VIF entry in instance network info cache for port c9d9e100-59bd-4f58-8892-80c764c88b85. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:59:15 user nova-compute[71330]: DEBUG nova.network.neutron [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Updating instance_info_cache with network_info: [{"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] Releasing lock "refresh_cache-47955121-a299-4b9b-aa83-0e55cfb52f4b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG nova.objects.instance [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'flavor' on Instance uuid 47955121-a299-4b9b-aa83-0e55cfb52f4b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:17 user nova-compute[71330]: INFO nova.compute.manager [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Attaching volume b46ef9cc-fb22-462d-a112-baf6fd6794d4 to /dev/vdb
Apr 14 11:59:17 user nova-compute[71330]: DEBUG os_brick.utils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0bf019-ee29-4c62-b594-6c6bf9961c3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[55552eaf-2271-43be-8599-f21ab8cf2581]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8027824c-1e9e-41d4-ba1e-2a0e984ea0fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[589444b8-d5c4-4431-aebc-861f7b87b6fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:17 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:59:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcafae9-0cc2-4448-a245-c1a1f32567ab]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG os_brick.utils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:17 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Updating existing volume attachment record: 9160796e-a971-4b22-9017-b343e8430b25 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:59:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received event network-changed-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Refreshing instance network info cache due to event network-changed-4a2c37e2-c105-4bee-940b-19f8974cd14b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:59:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] Acquiring lock "refresh_cache-8c623c90-6b65-4de1-a67a-c7f667aa2d8d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:59:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] Acquired lock "refresh_cache-8c623c90-6b65-4de1-a67a-c7f667aa2d8d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:59:19 user nova-compute[71330]: DEBUG nova.network.neutron [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Refreshing network info cache for port 4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:59:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Updated VIF entry in instance network info cache for port 4a2c37e2-c105-4bee-940b-19f8974cd14b. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Updating instance_info_cache with network_info: [{"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] Releasing lock "refresh_cache-8c623c90-6b65-4de1-a67a-c7f667aa2d8d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lazy-loading 'flavor' on Instance uuid 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:20 user nova-compute[71330]: INFO nova.compute.manager [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Attaching volume acbd4443-4921-4ac7-89aa-638371f4b639 to /dev/vdb
Apr 14 11:59:20 user nova-compute[71330]: DEBUG os_brick.utils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[48269814-e2f4-4cd5-a69d-d5df17264094]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b0119a-a450-49a2-ba99-bbb3e326f704]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5db435e-2aae-4068-9d08-8ce3db3da21e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0fbae9-707b-483d-972f-880a6d558a84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:20 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:59:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[173baa61-4824-4dae-97ac-f00ac7ae1512]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG os_brick.utils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:20 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Updating existing volume attachment record: d1d5b167-e8e4-4d65-bcbc-c2760eed97c7 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received event network-changed-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Refreshing instance network info cache due to event network-changed-c7a8788d-e6ec-4958-8755-b88f421793c3. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] Acquiring lock "refresh_cache-34c3100c-5b90-47a1-8c3b-fb53467fcd20" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] Acquired lock "refresh_cache-34c3100c-5b90-47a1-8c3b-fb53467fcd20" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG nova.network.neutron [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Refreshing network info cache for port c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG nova.network.neutron [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Updated VIF entry in instance network info cache for port c7a8788d-e6ec-4958-8755-b88f421793c3. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG nova.network.neutron [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Updating instance_info_cache with network_info: [{"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] Releasing lock "refresh_cache-34c3100c-5b90-47a1-8c3b-fb53467fcd20" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG nova.objects.instance [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lazy-loading 'flavor' on Instance uuid 8c623c90-6b65-4de1-a67a-c7f667aa2d8d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:21 user nova-compute[71330]: INFO nova.compute.manager [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Attaching volume 987cb3c1-d233-460f-95b4-593e3c290f7d to /dev/sdc
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.utils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0961c42-86d0-4f6c-bbb3-35d20a6adfd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbb3b07-a273-471a-a231-01ae86d8f0cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[083950dc-472b-4823-ad1b-cc07bdff7c26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc908a8-592f-4e85-8bb4-825ede1becda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:22 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e015c5f8-9ef8-4395-8d65-86163d9af4fd]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.utils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Updating existing volume attachment record: e870ec34-8867-40e6-b960-c43c53503d6f {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVxdfaPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:22 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:22 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:22 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf29abaa-f9db-4177-aafe-20bd212d9b2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:59:22 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e64bd35-647d-445d-ae6c-4963325ff89c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4] added
Apr 14 11:59:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc729869-fee0-46d7-bb23-ee043f3533c4]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[611450ca-23e9-4c36-b828-9affccc1ddbe]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVxdfaPq {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVxdfaPq" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f075e0-7752-4c50-8f38-6b18da4b964a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mVxdfaPq'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dd41f9-76a1-46dc-b671-d93b2b0deb7a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad86bb0a-c3b8-4e24-b97c-728f80ebe3f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad32786-3ec5-4b58-bfa0-0c20346481a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4, portal: 172.16.0.220,3260]
Apr 14 11:59:22 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d22368-d62a-4997-9753-aa8130259644]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e6f124-d5e6-45b8-a7f9-3ac37c6c0291]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)
Apr 14 11:59:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[869cd770-29cc-4020-af8c-683a6820081b]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:22 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:59:23 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:59:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVxdfaPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:59:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23532373463653962', 'path': '/dev/sdh'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532373463653962', 'path': '/dev/sdh'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:59:23 user nova-compute[71330]: DEBUG nova.objects.instance [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'flavor' on Instance uuid 47955121-a299-4b9b-aa83-0e55cfb52f4b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:59:23 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:23 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 11:59:23 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:59:23 user nova-compute[71330]:   <serial>b46ef9cc-fb22-462d-a112-baf6fd6794d4</serial>
Apr 14 11:59:23 user nova-compute[71330]: </disk>
Apr 14 11:59:23 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:59:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:59:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:59:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] No VIF found with MAC fa:16:3e:57:07:30, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:59:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.787s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMjtfCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:25 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:25 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:25 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a40215-7109-4cdf-ac4a-b89616108027]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:59:25 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b786ea7a-0e87-4488-8454-2ffc64d118a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639] added
Apr 14 11:59:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f83986-3cec-4fdb-a496-8444ed825e04]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed7acbc-5a93-40ad-9bb3-f538af583b9e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMjtfCvJ {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMjtfCvJ" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b010bce6-61e7-495a-81fb-da3df9cb4454]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iMjtfCvJ'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c4c6b1-bdd7-44fb-bc7a-8fdbabc09590]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f8949c-207c-4293-b347-ed6bb54199ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2fefb2-8dea-49cf-8569-62497f220d4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260]
Apr 14 11:59:25 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef8e760-58a5-450b-bbce-5210b427d372]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f1ed9-4eb8-4b65-99c3-c50ce1c61b81]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)
Apr 14 11:59:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec0053-b424-4e4c-8854-775e315b11b5]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMjtfCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:25 user nova-compute[71330]: INFO nova.compute.manager [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Detaching volume b46ef9cc-fb22-462d-a112-baf6fd6794d4
Apr 14 11:59:26 user nova-compute[71330]: INFO nova.virt.block_device [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Attempting to driver detach volume b46ef9cc-fb22-462d-a112-baf6fd6794d4 from mountpoint /dev/vdb
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Attempting to detach device vdb from instance 47955121-a299-4b9b-aa83-0e55cfb52f4b from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:59:26 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:26 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 11:59:26 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:59:26 user nova-compute[71330]:   <serial>b46ef9cc-fb22-462d-a112-baf6fd6794d4</serial>
Apr 14 11:59:26 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:59:26 user nova-compute[71330]: </disk>
Apr 14 11:59:26 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:59:26 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Successfully detached device vdb from instance 47955121-a299-4b9b-aa83-0e55cfb52f4b from the persistent domain config.
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47955121-a299-4b9b-aa83-0e55cfb52f4b from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:59:26 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:26 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 11:59:26 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:59:26 user nova-compute[71330]:   <serial>b46ef9cc-fb22-462d-a112-baf6fd6794d4</serial>
Apr 14 11:59:26 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:59:26 user nova-compute[71330]: </disk>
Apr 14 11:59:26 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473566.5043597, 47955121-a299-4b9b-aa83-0e55cfb52f4b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47955121-a299-4b9b-aa83-0e55cfb52f4b {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 11:59:26 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Successfully detached device vdb from instance 47955121-a299-4b9b-aa83-0e55cfb52f4b from the live domain config.
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVxdfaPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:26 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26536346434343333', 'path': '/dev/sdi'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536346434343333', 'path': '/dev/sdi'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.225s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lazy-loading 'flavor' on Instance uuid 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b66c690-78b5-4545-a8cf-4a949ee3637c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:26 user nova-compute[71330]: No targets found.
Apr 14 11:59:26 user nova-compute[71330]: iSNS:
Apr 14 11:59:26 user nova-compute[71330]: No targets found.
Apr 14 11:59:26 user nova-compute[71330]: STATIC:
Apr 14 11:59:26 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b
Apr 14 11:59:26 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:26 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:26 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:26 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:26 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:26 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9
Apr 14 11:59:26 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:26 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:26 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:59:26 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:26 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:26 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89
Apr 14 11:59:26 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:26 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:26 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb
Apr 14 11:59:26 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:26 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:26 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:26 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:26 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:26 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4
Apr 14 11:59:26 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:26 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:26 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:26 user nova-compute[71330]: No targets found.
Apr 14 11:59:26 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:26 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:26 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:59:26 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:26 user nova-compute[71330]:   <source dev="/dev/sdi"/>
Apr 14 11:59:26 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:59:26 user nova-compute[71330]:   <serial>acbd4443-4921-4ac7-89aa-638371f4b639</serial>
Apr 14 11:59:26 user nova-compute[71330]: </disk>
Apr 14 11:59:26 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[60009830-2abb-41fc-b0ab-bd33e756aa5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[597aeb5e-2d08-42c0-b7b8-219dfc4812ba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 (non-flash)
Apr 14 11:59:26 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495c3e9ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4'): ({'sdh'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Removing single pathed devices sdh {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[18036221-9cc1-429e-9d6b-c5a212ff63a6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8111ba-dd59-4d1d-9bf8-8e7e1af42d88]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Flushing IO for device /dev/sdh {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10c5c7d-621b-4b7c-adea-ee08c654a6bf]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPQdaelp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:26 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[522311a5-433d-4cb6-9a14-bfc5d0ab3a47]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6892095-9772-4006-a30f-1349277af4eb]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fa2a8f-8ab9-4efd-8e7b-ed88ba17e751]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4, portal: 172.16.0.220,3260]
Apr 14 11:59:27 user nova-compute[71330]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46ef9cc-fb22-462d-a112-baf6fd6794d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d8f389-6dd0-42aa-8f63-cfc45b951afa]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] <== disconnect_volume: return (579ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.179s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:27 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:27 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d576df-420a-48c0-ac4f-441c517afed0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:59:27 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a6bb84-c9f0-47ef-974d-2371467084a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d] added
Apr 14 11:59:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1199ed40-f73d-42b0-ab47-688f01613d97]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cdc95e-ee0a-4bbc-82ac-59e4188b12a7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] No VIF found with MAC fa:16:3e:35:b4:c4, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPQdaelp {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPQdaelp" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[250f0876-a943-44c0-b11e-96327a606fca]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bPQdaelp'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7413a349-fcd9-408c-9c77-a3ab99c51a18]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2591c6-a092-4f14-b7a3-d8214c5bff6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.755s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f54dfa-6fbf-44f1-b754-e7cbd6b3bb15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d, portal: 172.16.0.220,3260]
Apr 14 11:59:27 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c0f6f-6663-47e9-bbc1-b12546cfbb18]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f907e0-1502-44bc-833c-797526ede674]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:27 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f8e2bd-1d36-48a1-813a-2b6c52bd5eaf]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPQdaelp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'flavor' on Instance uuid 47955121-a299-4b9b-aa83-0e55cfb52f4b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] <== connect_volume: return (1543ms) {'type': 'block', 'scsi_wwn': '26636633538393333', 'path': '/dev/sdh'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636633538393333', 'path': '/dev/sdh'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG nova.objects.instance [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lazy-loading 'flavor' on Instance uuid 8c623c90-6b65-4de1-a67a-c7f667aa2d8d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:59:28 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:28 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 11:59:28 user nova-compute[71330]:   <target dev="sdc" bus="scsi"/>
Apr 14 11:59:28 user nova-compute[71330]:   <serial>987cb3c1-d233-460f-95b4-593e3c290f7d</serial>
Apr 14 11:59:28 user nova-compute[71330]:   <address type="drive" controller="0" unit="2"/>
Apr 14 11:59:28 user nova-compute[71330]: </disk>
Apr 14 11:59:28 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG os_brick.utils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b5253-8c94-4b1b-afb8-139247169569]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e5cf9-341b-4f74-b336-35921f34b4fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7a76b6-d0a2-4cac-bfdb-d172a49134dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce5b762-5858-4d5e-86eb-4ded85df0cf8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:28 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:59:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[475f9536-2a25-4d27-8026-cab2e6ca2b1c]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG os_brick.utils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:28 user nova-compute[71330]: INFO nova.compute.manager [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Swapping volume acbd4443-4921-4ac7-89aa-638371f4b639 for 3518928d-9ba4-4daf-8a56-73b39a894c8c
Apr 14 11:59:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] No BDM found with device name sda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:59:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] No VIF found with MAC fa:16:3e:dd:a7:37, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:59:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.199s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:29 user nova-compute[71330]: INFO nova.compute.manager [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Detaching volume 987cb3c1-d233-460f-95b4-593e3c290f7d
Apr 14 11:59:29 user nova-compute[71330]: INFO nova.virt.block_device [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Attempting to driver detach volume 987cb3c1-d233-460f-95b4-593e3c290f7d from mountpoint /dev/sdc
Apr 14 11:59:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Attempting to detach device sdc from instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 11:59:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:59:29 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:29 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 11:59:29 user nova-compute[71330]:   <target dev="sdc" bus="scsi"/>
Apr 14 11:59:29 user nova-compute[71330]:   <serial>987cb3c1-d233-460f-95b4-593e3c290f7d</serial>
Apr 14 11:59:29 user nova-compute[71330]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 11:59:29 user nova-compute[71330]: </disk>
Apr 14 11:59:29 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:59:29 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Successfully detached device sdc from instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d from the persistent domain config.
Apr 14 11:59:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 11:59:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:59:29 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:29 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 11:59:29 user nova-compute[71330]:   <target dev="sdc" bus="scsi"/>
Apr 14 11:59:29 user nova-compute[71330]:   <serial>987cb3c1-d233-460f-95b4-593e3c290f7d</serial>
Apr 14 11:59:29 user nova-compute[71330]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 11:59:29 user nova-compute[71330]: </disk>
Apr 14 11:59:29 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473570.3131425, 8c623c90-6b65-4de1-a67a-c7f667aa2d8d => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 11:59:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Successfully detached device sdc from instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d from the live domain config.
Apr 14 11:59:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPQdaelp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:30 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cfce21-1d6c-416e-85ae-21f6bf76db3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:30 user nova-compute[71330]: No targets found.
Apr 14 11:59:30 user nova-compute[71330]: iSNS:
Apr 14 11:59:30 user nova-compute[71330]: No targets found.
Apr 14 11:59:30 user nova-compute[71330]: STATIC:
Apr 14 11:59:30 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b
Apr 14 11:59:30 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:30 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:30 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:30 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:30 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:30 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9
Apr 14 11:59:30 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:30 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:30 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d
Apr 14 11:59:30 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:30 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:30 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:59:30 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:30 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:30 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89
Apr 14 11:59:30 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:30 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:30 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb
Apr 14 11:59:30 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:30 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:30 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:30 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:30 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:30 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:30 user nova-compute[71330]: No targets found.
Apr 14 11:59:30 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:30 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:30 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc90e811-d8a0-409f-8c70-02eb6f3a1b83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a51b97b-4c40-4ea5-9c4e-448167373bac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:30 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:30 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:30 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49542420e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d'): ({'sdh'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Removing single pathed devices sdh {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f677e78a-9bf4-4c1f-bfbe-67c7c397225b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7ce0ae-ed56-4789-911e-ef3ccba6b8a2]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Flushing IO for device /dev/sdh {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c8dd0a-a377-4c5c-b8f8-626b5fdbc7d8]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ee3942-83d6-4d7d-bc6a-f87c8184a80b]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2155cb-06ac-4737-8696-065fda1a8507]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba5b968-01b9-46c1-8076-2b1a733ea669]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d, portal: 172.16.0.220,3260]
Apr 14 11:59:30 user nova-compute[71330]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:30 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:987cb3c1-d233-460f-95b4-593e3c290f7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5abf237-1b64-4c7c-b687-a2fe6d9e99d2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] <== disconnect_volume: return (333ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:31 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lazy-loading 'flavor' on Instance uuid 8c623c90-6b65-4de1-a67a-c7f667aa2d8d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:32 user nova-compute[71330]: INFO nova.compute.manager [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Terminating instance
Apr 14 11:59:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received event network-vif-unplugged-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] No waiting events found dispatching network-vif-unplugged-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received event network-vif-unplugged-4a2c37e2-c105-4bee-940b-19f8974cd14b for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:33 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Instance destroyed successfully.
Apr 14 11:59:33 user nova-compute[71330]: DEBUG nova.objects.instance [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lazy-loading 'resources' on Instance uuid 8c623c90-6b65-4de1-a67a-c7f667aa2d8d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1705502030',display_name='tempest-AttachSCSIVolumeTestJSON-server-1705502030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1705502030',id=8,image_ref='dc9523c9-daf3-4272-8e02-b92a3a7c0d83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/hlJvXTsRRVQvidTptIsRMFnw3Jy3r5uWyt2kDmqw36j4Asj/F788AI8sVwzfK2jtJbozkD60b+PDsNysUI98/94z1eLuz7MUzjnwC4PtQItCXh82r9AOr1jQqnNZSYw==',key_name='tempest-keypair-553945765',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f35ab5f0a0e2453a8c5ad32e11aca784',ramdisk_id='',reservation_id='r-5aigq5o0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dc9523c9-daf3-4272-8e02-b92a3a7c0d83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-291907837',owner_user_name='tempest-AttachSCSIVolumeTestJSON-291907837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:57:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30b06ef2f13f421c967f4c86c46e5293',uuid=8c623c90-6b65-4de1-a67a-c7f667aa2d8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Converting VIF {"id": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "address": "fa:16:3e:dd:a7:37", "network": {"id": "23922266-3224-4b12-b7d2-0e4fd14ac4bb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1310531511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35ab5f0a0e2453a8c5ad32e11aca784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c37e2-c1", "ovs_interfaceid": "4a2c37e2-c105-4bee-940b-19f8974cd14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:a7:37,bridge_name='br-int',has_traffic_filtering=True,id=4a2c37e2-c105-4bee-940b-19f8974cd14b,network=Network(23922266-3224-4b12-b7d2-0e4fd14ac4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c37e2-c1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_vif [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:a7:37,bridge_name='br-int',has_traffic_filtering=True,id=4a2c37e2-c105-4bee-940b-19f8974cd14b,network=Network(23922266-3224-4b12-b7d2-0e4fd14ac4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c37e2-c1') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a2c37e2-c1, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:33 user nova-compute[71330]: INFO os_vif [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:a7:37,bridge_name='br-int',has_traffic_filtering=True,id=4a2c37e2-c105-4bee-940b-19f8974cd14b,network=Network(23922266-3224-4b12-b7d2-0e4fd14ac4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c37e2-c1')
Apr 14 11:59:33 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Deleting instance files /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d_del
Apr 14 11:59:33 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Deletion of /opt/stack/data/nova/instances/8c623c90-6b65-4de1-a67a-c7f667aa2d8d_del complete
Apr 14 11:59:33 user nova-compute[71330]: INFO nova.compute.manager [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKmYbcEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34c3100c-5b90-47a1-8c3b-fb53467fcd20', 'attached_at': '', 'detached_at': '', 'volume_id': '3518928d-9ba4-4daf-8a56-73b39a894c8c', 'serial': '3518928d-9ba4-4daf-8a56-73b39a894c8c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMjtfCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '34c3100c-5b90-47a1-8c3b-fb53467fcd20', 'attached_at': '', 'detached_at': '', 'volume_id': 'acbd4443-4921-4ac7-89aa-638371f4b639', 'serial'} {{(pid=71330) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKmYbcEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:33 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:33 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:33 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c28089-7b9a-40f1-a3a4-7f9f399ffc01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:59:33 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef47404-45a4-4567-b5b6-f2c92834b9d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c] added
Apr 14 11:59:33 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae36378e-45c6-4779-afeb-3f9efa048f08]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a1fd92-7e8c-4340-96ab-8b3ebf43787b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKmYbcEh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKmYbcEh" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d60bf17-5f74-4b82-a7c9-cf037d30ed60]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WKmYbcEh'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3aeb47-ddca-4d24-a375-ab0d5a05f05b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c872c2-5edb-495a-9015-751bb7895ae9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bbea42-d726-4e84-9504-e85d948c5c22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c, portal: 172.16.0.220,3260]
Apr 14 11:59:33 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:33 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae9344b-b6fc-426b-944d-53755fb94aed]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[52271ea8-e1a7-456c-9968-c20d4fe0d4e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:33 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:33 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99d20b5-39ae-42f5-8a64-53e509f5877a]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:59:33 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKmYbcEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:34 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Took 1.03 seconds to deallocate network for instance.
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received event network-vif-deleted-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:34 user nova-compute[71330]: INFO nova.compute.manager [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Neutron deleted interface 4a2c37e2-c105-4bee-940b-19f8974cd14b; detaching it from the instance and deleting it from the info cache
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.network.neutron [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Detach interface failed, port_id=4a2c37e2-c105-4bee-940b-19f8974cd14b, reason: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received event network-vif-plugged-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] Acquiring lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] No waiting events found dispatching network-vif-plugged-4a2c37e2-c105-4bee-940b-19f8974cd14b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:34 user nova-compute[71330]: WARNING nova.compute.manager [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Received unexpected event network-vif-plugged-4a2c37e2-c105-4bee-940b-19f8974cd14b for instance with vm_state deleted and task_state None.
Apr 14 11:59:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26633653839643934', 'path': '/dev/sdh'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633653839643934', 'path': '/dev/sdh'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG nova.objects.instance [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lazy-loading 'flavor' on Instance uuid 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:34 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Deleted allocations for instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d
Apr 14 11:59:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "8c623c90-6b65-4de1-a67a-c7f667aa2d8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.611s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 339738624 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 520093696 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 684720128 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 857735168 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 1028653056 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMjtfCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:38 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09e1e86-0ceb-4730-8d53-eaeabe769db0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:39 user nova-compute[71330]: No targets found.
Apr 14 11:59:39 user nova-compute[71330]: iSNS:
Apr 14 11:59:39 user nova-compute[71330]: No targets found.
Apr 14 11:59:39 user nova-compute[71330]: STATIC:
Apr 14 11:59:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b
Apr 14 11:59:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9
Apr 14 11:59:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:59:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89
Apr 14 11:59:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c
Apr 14 11:59:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb
Apr 14 11:59:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:39 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:39 user nova-compute[71330]: No targets found.
Apr 14 11:59:39 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:39 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:39 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8c7f8-1042-45dd-98ad-4eb895fb2955]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1e4018-104a-4d53-b2ba-07c6d6e495a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:39 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:39 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:39 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495c3e8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639'): ({'sdi'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Removing single pathed devices sdi {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e6f5e6-24a2-4213-ac4b-7fee7d56fbfd]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a5d413-4060-4f49-ad09-7ce62451dec4]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Flushing IO for device /dev/sdi {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ddcec8-ab8b-4031-bf98-111769088ad7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.033s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[34db45cf-fc00-4a76-b49d-a4142ae37147]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] SCSI volumes sdi have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[425e240a-53ec-47fd-8d6d-ef5705314a11]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9745033-0470-4ac2-925a-a7f0a74438bd]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260]
Apr 14 11:59:39 user nova-compute[71330]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:39 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8f386b-c625-47ae-a073-28351d1f2230]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] <== disconnect_volume: return (334ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKmYbcEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '34c3100c-5b90-47a1-8c3b-fb53467fcd20', 'attached_at': '', 'detached_at': '', 'volume_id': '3518928d-9ba4-4daf-8a56-73b39a894c8c', 'serial'} {{(pid=71330) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 11:59:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] swap_volume: removing Cinder connection for volume acbd4443-4921-4ac7-89aa-638371f4b639 {{(pid=71330) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG nova.compute.manager [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] swap_volume: Updating volume acbd4443-4921-4ac7-89aa-638371f4b639 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WKmYbcEh", "auth_password": "RQs0yMYE91hPlO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "3518928d-9ba4-4daf-8a56-73b39a894c8c"}, "status": "reserved", "instance": "34c3100c-5b90-47a1-8c3b-fb53467fcd20", "attached_at": "", "detached_at": "", "volume_id": "3518928d-9ba4-4daf-8a56-73b39a894c8c", "serial": "3518928d-9ba4-4daf-8a56-73b39a894c8c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3518928d-9ba4-4daf-8a56-73b39a894c8c', 'no_device': None, 'attachment_id': '522b987b-bfc1-4c3c-844d-3b7eaaf95bf4'} {{(pid=71330) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.747s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG os_brick.utils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be482c5-a48d-451a-989a-0ff76a7b5ab2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4918bf-4a48-49dc-ad34-54b400f5a838]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[34894d30-8063-4eed-b607-6058798ef803]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2339c2b6-9f0c-4730-85bd-066cabcef409]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:41 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:59:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9d5c21-eae0-460d-a5f0-926e01ef6e96]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG os_brick.utils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:41 user nova-compute[71330]: INFO nova.compute.manager [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Swapping volume 3518928d-9ba4-4daf-8a56-73b39a894c8c for acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG nova.objects.instance [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'flavor' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:42 user nova-compute[71330]: INFO nova.compute.manager [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Attaching volume 02f6321c-fa2b-4e36-8b89-caffe1df4027 to /dev/vdb
Apr 14 11:59:42 user nova-compute[71330]: DEBUG os_brick.utils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba71410-f8ab-4b42-ac63-e4ae69164417]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ccdb82-e160-4851-9442-388cbeaed520]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f85f9a-df9c-403b-b6b4-8a70bf7efdce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9646237-be92-4e1d-be23-dd71b6e27e15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:59:42 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:59:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ed57bb-f51e-4138-8ff2-0816e3bfacf2]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG os_brick.utils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:42 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating existing volume attachment record: 0bae58be-e772-4e0e-b658-a2ecbb27239b {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:59:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMjtfCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34c3100c-5b90-47a1-8c3b-fb53467fcd20', 'attached_at': '', 'detached_at': '', 'volume_id': 'acbd4443-4921-4ac7-89aa-638371f4b639', 'serial': 'acbd4443-4921-4ac7-89aa-638371f4b639'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKmYbcEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '3518928d-9ba4-4daf-8a56-73b39a894c8c'}, 'status': 'reserved', 'instance': '34c3100c-5b90-47a1-8c3b-fb53467fcd20', 'attached_at': '', 'detached_at': '', 'volume_id': '3518928d-9ba4-4daf-8a56-73b39a894c8c', 'serial'} {{(pid=71330) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMjtfCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:45 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:45 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:45 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ba9eb2-f133-4c5f-8f07-947988248a0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:59:45 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6e5f30-16b4-4450-a047-e7542581aa71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639] added
Apr 14 11:59:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fcc221-dc17-4aab-9726-05ec4daa5227]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafac7df-7ddb-4554-b304-ebb9ee6367c2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMjtfCvJ {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMjtfCvJ" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef355ee3-5796-4e41-aa2b-ba2c398ee36c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iMjtfCvJ'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc9e162-b66c-4e91-8aee-d428d1c6180a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[43926142-5aeb-4260-b117-4c2e9120d4df]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b850cd-e598-4d2d-b118-ce2371632a9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260]
Apr 14 11:59:45 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[27718fc4-80c3-497a-95f3-1b7aef639d84]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3bba65-a4c6-46f5-b999-1129481999eb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:45 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9897ce-f376-47f7-b183-859c5de0a262]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-changed-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing instance network info cache due to event network-changed-6ea5022d-9892-4cd9-90a9-4328326b209d. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] Acquiring lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] Acquired lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG nova.network.neutron [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Refreshing network info cache for port 6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMjtfCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26536346434343333', 'path': '/dev/sdi'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536346434343333', 'path': '/dev/sdi'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJWXHFac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:46 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:46 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:46 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lazy-loading 'flavor' on Instance uuid 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c64b29-07e6-4cfc-a31a-e8ba08ac8ff9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:59:46 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e231a589-bb2a-4a15-aade-97b9d0b12c7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027] added
Apr 14 11:59:46 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d29006-6e7c-4ea1-87a6-d7b1793e173a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[594fbf5d-5125-47d6-a555-5f90f4859105]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJWXHFac {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJWXHFac" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb59655-3a78-4ad3-8506-d059e7ece145]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eJWXHFac'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f74dce-44a1-4b33-9795-6f7becd8933d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[615f2da6-5baa-430f-be31-a8c66f4d1d9e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e9e3df-8e69-4c1b-868d-6fb8c4f7424b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260]
Apr 14 11:59:47 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df04ad0-f736-4c3e-b44e-4663537b0c7e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db11dbd-7bf3-48a6-9645-33c9fc4be6ea]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:47 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5afffa-9dc2-4565-90b3-9935d4e706b4]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJWXHFac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG nova.network.neutron [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updated VIF entry in instance network info cache for port 6ea5022d-9892-4cd9-90a9-4328326b209d. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG nova.network.neutron [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [{"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] Releasing lock "refresh_cache-b97d3633-4864-45fa-8d87-968507e13639" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:59:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 158334976 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473573.0820777, 8c623c90-6b65-4de1-a67a-c7f667aa2d8d => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:59:48 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] VM Stopped (Lifecycle Event)
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f8b0ef7d-a877-4885-a851-bd0dc90c97d1 None None] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23363636665376337', 'path': '/dev/sdj'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363636665376337', 'path': '/dev/sdj'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'flavor' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:59:48 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:48 user nova-compute[71330]:   <source dev="/dev/sdj"/>
Apr 14 11:59:48 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:59:48 user nova-compute[71330]:   <serial>02f6321c-fa2b-4e36-8b89-caffe1df4027</serial>
Apr 14 11:59:48 user nova-compute[71330]: </disk>
Apr 14 11:59:48 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 350224384 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "b97d3633-4864-45fa-8d87-968507e13639" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:48 user nova-compute[71330]: INFO nova.compute.manager [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Terminating instance
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 502267904 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No VIF found with MAC fa:16:3e:4f:d4:34, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.034s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 643825664 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-unplugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-unplugged-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-6ea5022d-9892-4cd9-90a9-4328326b209d for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 792723456 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-unplugged-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-1dc3ed86-ee69-4541-a687-409bb40f1966 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updating instance_info_cache with network_info: [{"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 923795456 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:50 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b97d3633-4864-45fa-8d87-968507e13639] Instance destroyed successfully.
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lazy-loading 'resources' on Instance uuid b97d3633-4864-45fa-8d87-968507e13639 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:07:33,bridge_name='br-int',has_traffic_filtering=True,id=6ea5022d-9892-4cd9-90a9-4328326b209d,network=Network(8efae657-134b-4684-b335-14ca3539ebe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea5022d-98') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:07:33,bridge_name='br-int',has_traffic_filtering=True,id=6ea5022d-9892-4cd9-90a9-4328326b209d,network=Network(8efae657-134b-4684-b335-14ca3539ebe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea5022d-98') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ea5022d-98, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:50 user nova-compute[71330]: INFO os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:07:33,bridge_name='br-int',has_traffic_filtering=True,id=6ea5022d-9892-4cd9-90a9-4328326b209d,network=Network(8efae657-134b-4684-b335-14ca3539ebe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea5022d-98')
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:00,bridge_name='br-int',has_traffic_filtering=True,id=314dd23d-4b31-40a2-9a19-37613754a61b,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap314dd23d-4b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:00,bridge_name='br-int',has_traffic_filtering=True,id=314dd23d-4b31-40a2-9a19-37613754a61b,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap314dd23d-4b') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap314dd23d-4b, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 1023410176 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: INFO os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:00,bridge_name='br-int',has_traffic_filtering=True,id=314dd23d-4b31-40a2-9a19-37613754a61b,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap314dd23d-4b')
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4d:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ee869ed-353a-4e35-b0d9-57f8441c91ff,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ee869ed-35') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4d:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ee869ed-353a-4e35-b0d9-57f8441c91ff,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ee869ed-35') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ee869ed-35, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: INFO os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4d:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ee869ed-353a-4e35-b0d9-57f8441c91ff,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ee869ed-35')
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:02:37,bridge_name='br-int',has_traffic_filtering=True,id=b786ac42-d885-4cbb-a03c-5d7c17adfae2,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb786ac42-d8') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:02:37,bridge_name='br-int',has_traffic_filtering=True,id=b786ac42-d885-4cbb-a03c-5d7c17adfae2,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb786ac42-d8') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb786ac42-d8, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: INFO os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:02:37,bridge_name='br-int',has_traffic_filtering=True,id=b786ac42-d885-4cbb-a03c-5d7c17adfae2,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb786ac42-d8')
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "1dc3ed86-ee69-4541-a687-409bb40f1966", "address": "fa:16:3e:8c:13:a3", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc3ed86-ee", "ovs_interfaceid": "1dc3ed86-ee69-4541-a687-409bb40f1966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:a3,bridge_name='br-int',has_traffic_filtering=True,id=1dc3ed86-ee69-4541-a687-409bb40f1966,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc3ed86-ee') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:a3,bridge_name='br-int',has_traffic_filtering=True,id=1dc3ed86-ee69-4541-a687-409bb40f1966,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc3ed86-ee') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dc3ed86-ee, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: INFO os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:a3,bridge_name='br-int',has_traffic_filtering=True,id=1dc3ed86-ee69-4541-a687-409bb40f1966,network=Network(74a9d6f0-ffb5-47ab-87a6-1c52030f9319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc3ed86-ee')
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:9d:c5,bridge_name='br-int',has_traffic_filtering=True,id=27a86908-d21f-46e8-a84d-66b055203f9b,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a86908-d2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9d:c5,bridge_name='br-int',has_traffic_filtering=True,id=27a86908-d21f-46e8-a84d-66b055203f9b,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a86908-d2') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27a86908-d2, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: INFO os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9d:c5,bridge_name='br-int',has_traffic_filtering=True,id=27a86908-d21f-46e8-a84d-66b055203f9b,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a86908-d2')
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172436186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1172436186',id=11,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw==',key_name='tempest-keypair-1582248460',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01aedc5467e84f3788269d2f35ff4cb0',ramdisk_id='',reservation_id='r-u4436jkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1593181551',owner_user_name='tempest-TaggedBootDevicesTest_v242-1593181551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e15f00ba92432e9c4a222e1b40c9ab',uuid=b97d3633-4864-45fa-8d87-968507e13639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converting VIF {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=737a9bf4-c102-475e-b791-c56b01f23d0d,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a9bf4-c1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=737a9bf4-c102-475e-b791-c56b01f23d0d,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a9bf4-c1') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap737a9bf4-c1, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:51 user nova-compute[71330]: INFO os_vif [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=737a9bf4-c102-475e-b791-c56b01f23d0d,network=Network(e413ef89-d659-445f-96cb-9dc71be4a9db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a9bf4-c1')
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWGCEDIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:51 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7870adfc-26f8-4e88-9a39-61f0c8f62df3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:51 user nova-compute[71330]: No targets found.
Apr 14 11:59:51 user nova-compute[71330]: iSNS:
Apr 14 11:59:51 user nova-compute[71330]: No targets found.
Apr 14 11:59:51 user nova-compute[71330]: STATIC:
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:51 user nova-compute[71330]: No targets found.
Apr 14 11:59:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:51 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:51 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c394b3fb-398d-482b-b885-b4a0dfd27c0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[687410c4-6a5b-461f-85ff-4a0f33aee89f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495c3eb640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa6c0cf-782a-4783-ae90-7ea1b449d7b4]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f07788-a7f3-4573-bd03-7e189c213086]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b45850-a45a-41cc-8738-6880a4bb9b35]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc07f47-4d73-4dbf-98dd-965f09637ed9]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[126b8108-89f4-4d39-bd1a-4000f206b149]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKmYbcEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '3518928d-9ba4-4daf-8a56-73b39a894c8c': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:51 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[084f7699-2f66-4b0c-9463-35770fa86b18]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:51 user nova-compute[71330]: WARNING nova.compute.manager [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance with vm_state active and task_state deleting.
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89, portal: 172.16.0.220,3260]
Apr 14 11:59:51 user nova-compute[71330]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-changed-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing instance network info cache due to event network-changed-e643b092-2a68-4a03-810c-74731525841b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Acquiring lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Acquired lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.network.neutron [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Refreshing network info cache for port e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b6d7b7-aee4-4c93-8b51-fe6da314cb89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c36e90a-5908-4db9-b1e5-97db3a7c0ce4]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.506s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] <== disconnect_volume: return (507ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.184s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsLuUcMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:51 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbff5ee-e2f2-49d1-a55f-5bea01490611]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:51 user nova-compute[71330]: No targets found.
Apr 14 11:59:51 user nova-compute[71330]: iSNS:
Apr 14 11:59:51 user nova-compute[71330]: No targets found.
Apr 14 11:59:51 user nova-compute[71330]: STATIC:
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 11:59:51 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:51 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:51 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:51 user nova-compute[71330]: No targets found.
Apr 14 11:59:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:51 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:51 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e6845a-386e-41b9-ab56-cfea3da907f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db50005-9648-4616-a7c7-a58345a2d741]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:51 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495412a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c'): ({'sdh'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Removing single pathed devices sdh {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:52 user nova-compute[71330]: WARNING nova.compute.manager [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-1dc3ed86-ee69-4541-a687-409bb40f1966 for instance with vm_state active and task_state deleting.
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-unplugged-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-737a9bf4-c102-475e-b791-c56b01f23d0d for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:52 user nova-compute[71330]: WARNING nova.compute.manager [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-737a9bf4-c102-475e-b791-c56b01f23d0d for instance with vm_state active and task_state deleting.
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11304d6-298e-4938-83d9-d734ffa264a5]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fa90c9-3fca-4e3b-a8c0-5d3eb6917deb]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Flushing IO for device /dev/sdh {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ec66e2-67be-4808-93d7-a95302cf70cb]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd9b44f-2cd9-4bb0-ad61-09158f7df8d4]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71c1df6-bd9d-4e7e-80e2-2382704c57b3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:52 user nova-compute[71330]: INFO nova.compute.manager [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Terminating instance
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[149d967a-16c0-4bfc-b365-3408d2b59597]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c, portal: 172.16.0.220,3260]
Apr 14 11:59:52 user nova-compute[71330]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3518928d-9ba4-4daf-8a56-73b39a894c8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e6a58-07c2-4e74-a3b7-c04acd209be5]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.494s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] <== disconnect_volume: return (678ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.497s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe60c18a-8f16-46e6-9fee-c34a5f4f8f68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:52 user nova-compute[71330]: No targets found.
Apr 14 11:59:52 user nova-compute[71330]: iSNS:
Apr 14 11:59:52 user nova-compute[71330]: No targets found.
Apr 14 11:59:52 user nova-compute[71330]: STATIC:
Apr 14 11:59:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b
Apr 14 11:59:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9
Apr 14 11:59:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:59:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb
Apr 14 11:59:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 11:59:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:52 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:52 user nova-compute[71330]: No targets found.
Apr 14 11:59:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:52 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:52 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMjtfCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '34c3100c-5b90-47a1-8c3b-fb53467fcd20', 'attached_at': '', 'detached_at': '', 'volume_id': 'acbd4443-4921-4ac7-89aa-638371f4b639', 'serial'} {{(pid=71330) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] swap_volume: removing Cinder connection for volume 3518928d-9ba4-4daf-8a56-73b39a894c8c {{(pid=71330) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b666f6dc-7ba7-4117-8db6-aa19450a6403]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f16d08-4abc-4c03-aa1b-4fa01f565346]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:52 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962cfb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b'): ({'sdd'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Removing single pathed devices sdd {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae509071-de3b-4fc6-835d-50ff8f4ba40e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34f798-c4b9-453a-b601-af63cc2e9753]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Flushing IO for device /dev/sdd {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c333145-a235-4160-a611-3bbfabae2780]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[442c757a-213b-4de4-86ef-ac2b18708038]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[425ddb30-c400-4afa-9eef-e13ee9214366]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b39605-5764-4b57-9db6-e5bc5b62e2f4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b, portal: 172.16.0.220,3260]
Apr 14 11:59:52 user nova-compute[71330]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb07ad60-62ba-467a-87a2-abe53abda98b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baa6877-15d4-484d-8686-253369b4c0e8]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.593s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] <== disconnect_volume: return (1090ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHvwcBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:52 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d7d801-5928-40da-8925-2b3e7fb8a9b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:53 user nova-compute[71330]: No targets found.
Apr 14 11:59:53 user nova-compute[71330]: iSNS:
Apr 14 11:59:53 user nova-compute[71330]: No targets found.
Apr 14 11:59:53 user nova-compute[71330]: STATIC:
Apr 14 11:59:53 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:53 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:53 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:53 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9
Apr 14 11:59:53 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:53 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:53 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:59:53 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:53 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:53 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb
Apr 14 11:59:53 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:53 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:53 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:53 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:53 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:53 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 11:59:53 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:53 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:53 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:53 user nova-compute[71330]: No targets found.
Apr 14 11:59:53 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:53 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:53 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8cf966-c390-491f-9889-844ae85bf35c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce07c3b-7d69-44a4-912c-2623269b6d4a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:53 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb (non-flash)
Apr 14 11:59:53 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:53 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962cfb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb'): ({'sdf'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Removing single pathed devices sdf {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e3f1fe-9e5d-4882-a449-97b4fc4d26f9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updated VIF entry in instance network info cache for port e643b092-2a68-4a03-810c-74731525841b. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [{"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7ecd5a-8874-4174-9bd4-64c1822b7d11]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Flushing IO for device /dev/sdf {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b696b0ae-4796-4d74-8c89-3659624098f1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Releasing lock "refresh_cache-132e2ee3-a757-42ef-b0ae-3441dca65da5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: WARNING nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-6ea5022d-9892-4cd9-90a9-4328326b209d for instance with vm_state active and task_state deleting.
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-unplugged-314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-314dd23d-4b31-40a2-9a19-37613754a61b for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-314dd23d-4b31-40a2-9a19-37613754a61b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: WARNING nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-314dd23d-4b31-40a2-9a19-37613754a61b for instance with vm_state active and task_state deleting.
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-unplugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: WARNING nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-3ee869ed-353a-4e35-b0d9-57f8441c91ff for instance with vm_state active and task_state deleting.
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-unplugged-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-unplugged-27a86908-d21f-46e8-a84d-66b055203f9b for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce68c2f-50f3-41ae-bdaa-4bacec1ee44a]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2e0af6-3973-4aed-aaec-e5add15e4b56]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[166efe47-de8d-4422-a7e0-f646d7c16987]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb, portal: 172.16.0.220,3260]
Apr 14 11:59:53 user nova-compute[71330]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:53 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ffdf09-b386-4f7b-956b-087ab6d671eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b536c6-0548-4167-9484-bf3d4f649d55]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.515s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] <== disconnect_volume: return (518ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:53 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Deleting instance files /opt/stack/data/nova/instances/b97d3633-4864-45fa-8d87-968507e13639_del
Apr 14 11:59:53 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Deletion of /opt/stack/data/nova/instances/b97d3633-4864-45fa-8d87-968507e13639_del complete
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: INFO nova.compute.manager [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Took 4.95 seconds to destroy the instance on the hypervisor.
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: b97d3633-4864-45fa-8d87-968507e13639] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b97d3633-4864-45fa-8d87-968507e13639] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-plugged-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Acquiring lock "b97d3633-4864-45fa-8d87-968507e13639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "b97d3633-4864-45fa-8d87-968507e13639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] No waiting events found dispatching network-vif-plugged-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: WARNING nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received unexpected event network-vif-plugged-27a86908-d21f-46e8-a84d-66b055203f9b for instance with vm_state active and task_state deleting.
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-unplugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: WARNING nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 for instance with vm_state active and task_state deleting.
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-unplugged-56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-56378bcd-5459-47e7-8424-345fc574ebc7 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:59:53 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Instance destroyed successfully.
Apr 14 11:59:53 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lazy-loading 'resources' on Instance uuid 132e2ee3-a757-42ef-b0ae-3441dca65da5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=e643b092-2a68-4a03-810c-74731525841b,network=Network(ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape643b092-2a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=e643b092-2a68-4a03-810c-74731525841b,network=Network(ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape643b092-2a') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape643b092-2a, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] swap_volume: Updating volume 3518928d-9ba4-4daf-8a56-73b39a894c8c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "iMjtfCvJ", "auth_password": "FE2X70A4QDjbIf", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "acbd4443-4921-4ac7-89aa-638371f4b639"}, "status": "reserved", "instance": "34c3100c-5b90-47a1-8c3b-fb53467fcd20", "attached_at": "", "detached_at": "", "volume_id": "acbd4443-4921-4ac7-89aa-638371f4b639", "serial": "acbd4443-4921-4ac7-89aa-638371f4b639"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'acbd4443-4921-4ac7-89aa-638371f4b639', 'no_device': None, 'attachment_id': 'b26ebdf8-3178-442c-9124-1d8d70b5fb99'} {{(pid=71330) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-unplugged-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-e643b092-2a68-4a03-810c-74731525841b for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:54 user nova-compute[71330]: WARNING nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-e643b092-2a68-4a03-810c-74731525841b for instance with vm_state active and task_state deleting.
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-unplugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:54 user nova-compute[71330]: WARNING nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance with vm_state active and task_state deleting.
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-unplugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.736s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:54 user nova-compute[71330]: INFO os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=e643b092-2a68-4a03-810c-74731525841b,network=Network(ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape643b092-2a')
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:20:b6,bridge_name='br-int',has_traffic_filtering=True,id=a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa78f67d0-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:20:b6,bridge_name='br-int',has_traffic_filtering=True,id=a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa78f67d0-ec') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa78f67d0-ec, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:54 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:59:54 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7767MB free_disk=26.44146728515625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: INFO os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:20:b6,bridge_name='br-int',has_traffic_filtering=True,id=a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa78f67d0-ec')
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:3f:46,bridge_name='br-int',has_traffic_filtering=True,id=56378bcd-5459-47e7-8424-345fc574ebc7,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56378bcd-54') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:3f:46,bridge_name='br-int',has_traffic_filtering=True,id=56378bcd-5459-47e7-8424-345fc574ebc7,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56378bcd-54') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56378bcd-54, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: INFO os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:3f:46,bridge_name='br-int',has_traffic_filtering=True,id=56378bcd-5459-47e7-8424-345fc574ebc7,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56378bcd-54')
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=7fc577b9-cdea-45d8-9e73-a5cae3b67eec,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc577b9-cd') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=7fc577b9-cdea-45d8-9e73-a5cae3b67eec,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc577b9-cd') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fc577b9-cd, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 25eda1c2-9b82-412f-b75d-358e87847a29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b97d3633-4864-45fa-8d87-968507e13639 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: INFO os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=7fc577b9-cdea-45d8-9e73-a5cae3b67eec,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc577b9-cd')
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "address": "fa:16:3e:d4:ad:7a", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a26f8b-64", "ovs_interfaceid": "18a26f8b-649d-4f0f-865f-cea6cd23372b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:7a,bridge_name='br-int',has_traffic_filtering=True,id=18a26f8b-649d-4f0f-865f-cea6cd23372b,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a26f8b-64') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:7a,bridge_name='br-int',has_traffic_filtering=True,id=18a26f8b-649d-4f0f-865f-cea6cd23372b,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a26f8b-64') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18a26f8b-64, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: INFO os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ad:7a,bridge_name='br-int',has_traffic_filtering=True,id=18a26f8b-649d-4f0f-865f-cea6cd23372b,network=Network(b94dcf66-3a7d-4c79-a7b2-f528ee9f436d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a26f8b-64')
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:35:02,bridge_name='br-int',has_traffic_filtering=True,id=9f35f7af-3587-48b6-9ee5-05dd1fdb00a4,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f35f7af-35') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:35:02,bridge_name='br-int',has_traffic_filtering=True,id=9f35f7af-3587-48b6-9ee5-05dd1fdb00a4,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f35f7af-35') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f35f7af-35, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: INFO os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:35:02,bridge_name='br-int',has_traffic_filtering=True,id=9f35f7af-3587-48b6-9ee5-05dd1fdb00a4,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f35f7af-35')
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T11:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-508386442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-508386442',id=12,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg==',key_name='tempest-keypair-342216412',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62161098b7244829bdeba1cfd1d6b970',ramdisk_id='',reservation_id='r-lohxd1wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1490636318',owner_user_name='tempest-TaggedBootDevicesTest-1490636318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0497d49f8544fe6b28101364faaadd7',uuid=132e2ee3-a757-42ef-b0ae-3441dca65da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converting VIF {"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab64dc7-8b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab64dc7-8b') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ab64dc7-8b, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:59:54 user nova-compute[71330]: INFO os_vif [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab,network=Network(63c80e08-8e48-4181-a64b-db7a6a669350),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab64dc7-8b')
Apr 14 11:59:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQBTWbrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:54 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[94171e92-c06a-4192-a28a-875c12a79a06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:54 user nova-compute[71330]: No targets found.
Apr 14 11:59:54 user nova-compute[71330]: iSNS:
Apr 14 11:59:54 user nova-compute[71330]: No targets found.
Apr 14 11:59:54 user nova-compute[71330]: STATIC:
Apr 14 11:59:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9
Apr 14 11:59:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:59:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 11:59:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:54 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:54 user nova-compute[71330]: No targets found.
Apr 14 11:59:54 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:54 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:54 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d54f25-9e74-44cb-aae5-871fd660e407]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0da2aa-0f90-4f34-b0b3-2096f48592ab]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962b55000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8996343c-dae1-46da-bb5b-02785ef3a96a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bd97be-50cc-42aa-96fe-cb53679defde]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[72348f3a-eac7-4177-8d95-fc071be580e7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cab5cd8-c22d-43c4-a66f-675acc9cd6cd]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da8e750-75c6-4b2a-84c1-98da3bc4f2d2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ec73ad-9271-4019-8908-9d4f9c047635]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9, portal: 172.16.0.220,3260]
Apr 14 11:59:55 user nova-compute[71330]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895ab6a9-dbf3-4601-a05b-a462b92efde9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[567fe104-e9f3-447b-974d-32e69b51288f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] <== disconnect_volume: return (353ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmIpGdRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:55 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1e65f3-6d8e-46f5-9f28-cf4e87dcf0cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:55 user nova-compute[71330]: No targets found.
Apr 14 11:59:55 user nova-compute[71330]: iSNS:
Apr 14 11:59:55 user nova-compute[71330]: No targets found.
Apr 14 11:59:55 user nova-compute[71330]: STATIC:
Apr 14 11:59:55 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:55 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:55 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:55 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f
Apr 14 11:59:55 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:55 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:55 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:55 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:55 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:55 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 11:59:55 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:55 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:55 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:55 user nova-compute[71330]: No targets found.
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:55 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:55 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b294e0-c02a-4298-97b9-9a1428af2df7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6008be1-5e41-481f-ae34-23020f2ceb9c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49541280d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f'): ({'sde'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Removing single pathed devices sde {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c465eeb-cac3-4e7b-bc6f-6664ba0fa2b1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1cb036-8857-4e31-89fe-06c9f6540555]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Flushing IO for device /dev/sde {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3fb7ab-dc3f-470b-bac1-cddf6976d5bf]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[021f31ae-0e34-4773-a231-a17c962f79fc]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] SCSI volumes sde have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0505a34-45c1-41ac-a0fb-7fe069fd7181]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cac286b-5b89-4ee2-9d61-21460220f0ea]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f, portal: 172.16.0.220,3260]
Apr 14 11:59:55 user nova-compute[71330]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8da01ce-a845-488b-8e7d-049d79697c6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d960e299-c082-41ef-8a91-63c868d60cee]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] <== disconnect_volume: return (382ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYFfydbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:55 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:55 user nova-compute[71330]: INFO nova.compute.manager [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Detaching volume acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d073ab-2502-4997-b691-521b943f3844]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:55 user nova-compute[71330]: No targets found.
Apr 14 11:59:55 user nova-compute[71330]: iSNS:
Apr 14 11:59:55 user nova-compute[71330]: No targets found.
Apr 14 11:59:55 user nova-compute[71330]: STATIC:
Apr 14 11:59:55 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:55 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:55 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:55 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938
Apr 14 11:59:55 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:55 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:55 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 11:59:55 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:55 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:55 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:55 user nova-compute[71330]: No targets found.
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:55 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:55 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7c8c8d-7a83-4598-9846-c803e7aa1e56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: INFO nova.virt.block_device [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Attempting to driver detach volume acbd4443-4921-4ac7-89aa-638371f4b639 from mountpoint /dev/vdb
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Attempting to detach device vdb from instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:59:55 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:55 user nova-compute[71330]:   <source dev="/dev/sdi"/>
Apr 14 11:59:55 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:59:55 user nova-compute[71330]:   <serial>acbd4443-4921-4ac7-89aa-638371f4b639</serial>
Apr 14 11:59:55 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:59:55 user nova-compute[71330]: </disk>
Apr 14 11:59:55 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:59:55 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Successfully detached device vdb from instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 from the persistent domain config.
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:59:55 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:59:55 user nova-compute[71330]:   <source dev="/dev/sdi"/>
Apr 14 11:59:55 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:59:55 user nova-compute[71330]:   <serial>acbd4443-4921-4ac7-89aa-638371f4b639</serial>
Apr 14 11:59:55 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:59:55 user nova-compute[71330]: </disk>
Apr 14 11:59:55 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1b9625-7560-47cb-b9de-7acadba3ec8d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 (non-flash)
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495c3e8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938'): ({'sdg'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Removing single pathed devices sdg {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acfb5f8-281f-4cfb-91dc-266cf4851b90]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[35492fca-2255-491a-aa7b-b4737ac39f82]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Flushing IO for device /dev/sdg {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d3f19f-6093-4d77-a86f-5dac7927fd0d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd49e71a-251d-443b-a0db-0cb1c1249634]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] SCSI volumes sdg have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[595dded3-b8e7-4802-8115-5651e74dab17]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a306b04d-7827-4678-9de6-4c4c2ef933d2]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938, portal: 172.16.0.220,3260]
Apr 14 11:59:55 user nova-compute[71330]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-56378bcd-5459-47e7-8424-345fc574ebc7 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:56 user nova-compute[71330]: WARNING nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-56378bcd-5459-47e7-8424-345fc574ebc7 for instance with vm_state active and task_state deleting.
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-unplugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:56 user nova-compute[71330]: WARNING nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance with vm_state active and task_state deleting.
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-unplugged-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-unplugged-18a26f8b-649d-4f0f-865f-cea6cd23372b for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:56 user nova-compute[71330]: WARNING nova.compute.manager [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-18a26f8b-649d-4f0f-865f-cea6cd23372b for instance with vm_state active and task_state deleting.
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda8c2c2-a10a-40f4-99f7-8b65ac91d938 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b03f3d9-934c-440c-80ef-78d043f3da49]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] <== disconnect_volume: return (358ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Deleting instance files /opt/stack/data/nova/instances/132e2ee3-a757-42ef-b0ae-3441dca65da5_del
Apr 14 11:59:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Deletion of /opt/stack/data/nova/instances/132e2ee3-a757-42ef-b0ae-3441dca65da5_del complete
Apr 14 11:59:56 user nova-compute[71330]: INFO nova.compute.manager [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Took 3.94 seconds to destroy the instance on the hypervisor.
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-plugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] Acquiring lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] No waiting events found dispatching network-vif-plugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:59:56 user nova-compute[71330]: WARNING nova.compute.manager [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received unexpected event network-vif-plugged-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance with vm_state active and task_state deleting.
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473596.2731297, 34c3100c-5b90-47a1-8c3b-fb53467fcd20 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 11:59:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Successfully detached device vdb from instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 from the live domain config.
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMjtfCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'acbd4443-4921-4ac7-89aa-638371f4b639': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:59:56 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d346df-77e9-4432-817e-9f133be039b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:59:56 user nova-compute[71330]: No targets found.
Apr 14 11:59:56 user nova-compute[71330]: iSNS:
Apr 14 11:59:56 user nova-compute[71330]: No targets found.
Apr 14 11:59:56 user nova-compute[71330]: STATIC:
Apr 14 11:59:56 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639
Apr 14 11:59:56 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:56 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:56 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 11:59:56 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:59:56 user nova-compute[71330]:                 Iface Name: default
Apr 14 11:59:56 user nova-compute[71330]: FIRMWARE:
Apr 14 11:59:56 user nova-compute[71330]: No targets found.
Apr 14 11:59:56 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:59:56 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:59:56 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e40c9b-324b-449e-9dbd-9fd45edda351]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa94a170-1e14-4bfd-8ba0-483c46880e9a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:56 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:56 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 (non-flash)
Apr 14 11:59:56 user nova-compute[71330]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 11:59:56 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962be4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639'): ({'sdi'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Removing single pathed devices sdi {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3b38b9-f992-45c9-9762-c06764957c23]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0421847a-123f-4bc9-8e11-0f73e211e6c1]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Flushing IO for device /dev/sdi {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4b8862-2ab5-486b-bd67-c48f6b8636b1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.057s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e69664-9b9d-4937-915d-fc4e3256375e]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] SCSI volumes sdi have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[861536b3-0c55-4d05-8899-f6548f68da3b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c254b4a-4ada-411a-8767-194f1e403a1d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260]
Apr 14 11:59:56 user nova-compute[71330]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639, portal: 172.16.0.220,3260] successful.
Apr 14 11:59:56 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbd4443-4921-4ac7-89aa-638371f4b639 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c0832-5c0d-4249-9721-8082e8ba4924]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] <== disconnect_volume: return (356ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:59:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:59:57 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lazy-loading 'flavor' on Instance uuid 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:59:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.010s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-deleted-1dc3ed86-ee69-4541-a687-409bb40f1966 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:58 user nova-compute[71330]: INFO nova.compute.manager [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Neutron deleted interface 1dc3ed86-ee69-4541-a687-409bb40f1966; detaching it from the instance and deleting it from the info cache
Apr 14 11:59:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [{"id": "6ea5022d-9892-4cd9-90a9-4328326b209d", "address": "fa:16:3e:60:07:33", "network": {"id": "8efae657-134b-4684-b335-14ca3539ebe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1904231901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea5022d-98", "ovs_interfaceid": "6ea5022d-9892-4cd9-90a9-4328326b209d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Detach interface failed, port_id=1dc3ed86-ee69-4541-a687-409bb40f1966, reason: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing instance network info cache due to event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] Acquiring lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] Acquired lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updated VIF entry in instance network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating instance_info_cache with network_info: [{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:59:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] Releasing lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:59:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:59:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-deleted-6ea5022d-9892-4cd9-90a9-4328326b209d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:00 user nova-compute[71330]: INFO nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Neutron deleted interface 6ea5022d-9892-4cd9-90a9-4328326b209d; detaching it from the instance and deleting it from the info cache
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.network.neutron [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [{"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a86908-d21f-46e8-a84d-66b055203f9b", "address": "fa:16:3e:be:9d:c5", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a86908-d2", "ovs_interfaceid": "27a86908-d21f-46e8-a84d-66b055203f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Detach interface failed, port_id=6ea5022d-9892-4cd9-90a9-4328326b209d, reason: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-deleted-27a86908-d21f-46e8-a84d-66b055203f9b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:00 user nova-compute[71330]: INFO nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Neutron deleted interface 27a86908-d21f-46e8-a84d-66b055203f9b; detaching it from the instance and deleting it from the info cache
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.network.neutron [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [{"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737a9bf4-c102-475e-b791-c56b01f23d0d", "address": "fa:16:3e:d0:1f:cf", "network": {"id": "e413ef89-d659-445f-96cb-9dc71be4a9db", "bridge": "br-int", "label": "tempest-device-tagging-net2-1052028599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a9bf4-c1", "ovs_interfaceid": "737a9bf4-c102-475e-b791-c56b01f23d0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Detach interface failed, port_id=27a86908-d21f-46e8-a84d-66b055203f9b, reason: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-deleted-18a26f8b-649d-4f0f-865f-cea6cd23372b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:00 user nova-compute[71330]: INFO nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Neutron deleted interface 18a26f8b-649d-4f0f-865f-cea6cd23372b; detaching it from the instance and deleting it from the info cache
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.network.neutron [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [{"id": "e643b092-2a68-4a03-810c-74731525841b", "address": "fa:16:3e:85:b4:b9", "network": {"id": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1892857539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape643b092-2a", "ovs_interfaceid": "e643b092-2a68-4a03-810c-74731525841b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "address": "fa:16:3e:aa:20:b6", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78f67d0-ec", "ovs_interfaceid": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56378bcd-5459-47e7-8424-345fc574ebc7", "address": "fa:16:3e:18:3f:46", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56378bcd-54", "ovs_interfaceid": "56378bcd-5459-47e7-8424-345fc574ebc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "address": "fa:16:3e:cf:ae:7e", "network": {"id": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "bridge": "br-int", "label": "tempest-device-tagging-net1-793432376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc577b9-cd", "ovs_interfaceid": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "address": "fa:16:3e:fc:35:02", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f35f7af-35", "ovs_interfaceid": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "address": "fa:16:3e:f4:e3:2c", "network": {"id": "63c80e08-8e48-4181-a64b-db7a6a669350", "bridge": "br-int", "label": "tempest-device-tagging-net2-502473323", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62161098b7244829bdeba1cfd1d6b970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab64dc7-8b", "ovs_interfaceid": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Detach interface failed, port_id=18a26f8b-649d-4f0f-865f-cea6cd23372b, reason: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-deleted-737a9bf4-c102-475e-b791-c56b01f23d0d {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:00 user nova-compute[71330]: INFO nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Neutron deleted interface 737a9bf4-c102-475e-b791-c56b01f23d0d; detaching it from the instance and deleting it from the info cache
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.network.neutron [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [{"id": "314dd23d-4b31-40a2-9a19-37613754a61b", "address": "fa:16:3e:39:62:00", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dd23d-4b", "ovs_interfaceid": "314dd23d-4b31-40a2-9a19-37613754a61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "address": "fa:16:3e:24:4d:1d", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee869ed-35", "ovs_interfaceid": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "address": "fa:16:3e:24:02:37", "network": {"id": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "bridge": "br-int", "label": "tempest-device-tagging-net1-390528596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "01aedc5467e84f3788269d2f35ff4cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb786ac42-d8", "ovs_interfaceid": "b786ac42-d885-4cbb-a03c-5d7c17adfae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Detach interface failed, port_id=737a9bf4-c102-475e-b791-c56b01f23d0d, reason: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:00:00 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b97d3633-4864-45fa-8d87-968507e13639] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:00 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b97d3633-4864-45fa-8d87-968507e13639] Took 6.80 seconds to deallocate network for instance.
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:02 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Took 6.06 seconds to deallocate network for instance.
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing instance network info cache due to event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Acquiring lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Acquired lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updated VIF entry in instance network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating instance_info_cache with network_info: [{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Releasing lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: b97d3633-4864-45fa-8d87-968507e13639] Received event network-vif-deleted-b786ac42-d885-4cbb-a03c-5d7c17adfae2 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-deleted-8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-deleted-9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-deleted-7fc577b9-cdea-45d8-9e73-a5cae3b67eec {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Received event network-vif-deleted-e643b092-2a68-4a03-810c-74731525841b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:02 user nova-compute[71330]: INFO nova.compute.manager [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Took 2.47 seconds to detach 3 volumes for instance.
Apr 14 12:00:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:03 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:00:03 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:00:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:03 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Deleted allocations for instance b97d3633-4864-45fa-8d87-968507e13639
Apr 14 12:00:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "b97d3633-4864-45fa-8d87-968507e13639" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.751s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:04 user nova-compute[71330]: INFO nova.compute.manager [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Rebooting instance
Apr 14 12:00:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquired lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating instance_info_cache with network_info: [{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Releasing lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:00:04 user nova-compute[71330]: INFO nova.compute.manager [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Took 2.54 seconds to detach 3 volumes for instance.
Apr 14 12:00:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-unplugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] No waiting events found dispatching network-vif-unplugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:00:05 user nova-compute[71330]: WARNING nova.compute.manager [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received unexpected event network-vif-unplugged-1aad7982-a338-4425-9e53-ea99f31b0de6 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 12:00:05 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Deleted allocations for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "132e2ee3-a757-42ef-b0ae-3441dca65da5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.031s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:05 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Instance destroyed successfully.
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'resources' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1398086214',display_name='tempest-TestMinimumBasicScenario-server-1398086214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1398086214',id=10,image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFIiKeQ/0Z0VfNZ6VUUlM9T5nZwFyI0LyXC8IRlH9W30muvQjtYrEeJ005baAqyTH/3Er2lAxmVvPn8aYg78pz/L256wjoD0MsMUEVdNJFcrEot77mjLycf8/vwxTsgA==',key_name='tempest-TestMinimumBasicScenario-565940781',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd9936aa363942f6a01bb64a8a8e74c9',ramdisk_id='',reservation_id='r-awo3v0q9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-881161311',owner_user_name='tempest-TestMinimumBasicScenario-881161311-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:00:05Z,user_data=None,user_id='2eb32a03e7e04da18568294cca0e69bd',uuid=25eda1c2-9b82-412f-b75d-358e87847a29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converting VIF {"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_vif [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aad7982-a3, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:00:05 user nova-compute[71330]: INFO os_vif [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3')
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJWXHFac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:00:05 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21ca360-a2cf-4e0b-af48-368074a09a50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:00:05 user nova-compute[71330]: No targets found.
Apr 14 12:00:05 user nova-compute[71330]: iSNS:
Apr 14 12:00:05 user nova-compute[71330]: No targets found.
Apr 14 12:00:05 user nova-compute[71330]: STATIC:
Apr 14 12:00:05 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 12:00:05 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:00:05 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:00:05 user nova-compute[71330]: FIRMWARE:
Apr 14 12:00:05 user nova-compute[71330]: No targets found.
Apr 14 12:00:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:00:05 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:00:05 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473590.6372223, b97d3633-4864-45fa-8d87-968507e13639 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:00:05 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b97d3633-4864-45fa-8d87-968507e13639] VM Stopped (Lifecycle Event)
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[64336479-89b7-4670-81ab-dd26ac9e51f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f35c8411-2ca9-4605-b22c-5b981578e4e6 None None] [instance: b97d3633-4864-45fa-8d87-968507e13639] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfca2a4-1019-47bd-b30e-66b579b8a4c9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:00:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:00:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495d536cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027'): ({'sdj'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Removing single pathed devices sdj {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3d5d75-05f5-4572-b9c4-bd1565a61b5d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a27de5-ddf4-4069-98bd-5ce7561111d0]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flushing IO for device /dev/sdj {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc153414-d915-4444-b717-a84e1951f51c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c61863-34a2-4369-a444-74399f934d19]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] SCSI volumes sdj have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1573ca2f-a062-49a0-8cb9-685d6a6a60c8]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c62862b-6fb9-4b31-a9e6-e0830e8a1c07]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260]
Apr 14 12:00:05 user nova-compute[71330]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260] successful.
Apr 14 12:00:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a4d0c9-1b49-4d8b-9e8b-6298a5e69951]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] <== disconnect_volume: return (309ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Start _get_guest_xml network_info=[{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e352d0f0-b1ad-42b1-b85d-d82679cbae9f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e352d0f0-b1ad-42b1-b85d-d82679cbae9f'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '0bae58be-e772-4e0e-b658-a2ecbb27239b', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJWXHFac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '25eda1c2-9b82-412f-b75d-358e87847a29', 'attached_at': '', 'detached_at': '', 'volume_id': '02f6321c-fa2b-4e36-8b89-caffe1df4027', 'serial': '02f6321c-fa2b-4e36-8b89-caffe1df4027'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:00:05 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:00:05 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e352d0f0-b1ad-42b1-b85d-d82679cbae9f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJWXHFac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:00:05 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:00:05 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:00:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:00:05 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:00:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6212b6-6bfa-4b62-b58f-24f8b7073c92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:00:06 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1effaac1-4c62-4e64-873b-89e94f123891]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027] added
Apr 14 12:00:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6e0250-98fe-4242-ac60-aebaf8f4614d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaab7d2-76fc-4bf6-ba05-e308b83fc9b6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJWXHFac {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJWXHFac" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d83149-f0cd-4b05-8d32-0cbff4fea3dd]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eJWXHFac'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f124c2-9d28-49fa-9688-a45ed8be0976]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[75376bda-bf98-4fd0-ae8e-36a93a1a61f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 12:00:06 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 12:00:06 user nova-compute[71330]:  {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:00:06 user nova-compute[71330]: WARNING os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 12:00:06 user nova-compute[71330]: 
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c673f3-7659-458c-ad62-4d42baf27ad4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260]
Apr 14 12:00:06 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260] successful.
Apr 14 12:00:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bc506b-8896-4fc4-939d-a637a579db90]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d018c8b3-e2a4-443b-ab4b-6648897c89f2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:00:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:00:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1373be-01b7-4932-b18d-cea4f2f271fa]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:00:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJWXHFac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] No waiting events found dispatching network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:00:07 user nova-compute[71330]: WARNING nova.compute.manager [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received unexpected event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 12:00:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23363636665376337', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363636665376337', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1398086214',display_name='tempest-TestMinimumBasicScenario-server-1398086214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1398086214',id=10,image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFIiKeQ/0Z0VfNZ6VUUlM9T5nZwFyI0LyXC8IRlH9W30muvQjtYrEeJ005baAqyTH/3Er2lAxmVvPn8aYg78pz/L256wjoD0MsMUEVdNJFcrEot77mjLycf8/vwxTsgA==',key_name='tempest-TestMinimumBasicScenario-565940781',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd9936aa363942f6a01bb64a8a8e74c9',ramdisk_id='',reservation_id='r-awo3v0q9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-881161311',owner_user_name='tempest-TestMinimumBasicScenario-881161311-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:00:05Z,user_data=None,user_id='2eb32a03e7e04da18568294cca0e69bd',uuid=25eda1c2-9b82-412f-b75d-358e87847a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converting VIF {"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'pci_devices' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:00:07 user nova-compute[71330]:   <uuid>25eda1c2-9b82-412f-b75d-358e87847a29</uuid>
Apr 14 12:00:07 user nova-compute[71330]:   <name>instance-0000000a</name>
Apr 14 12:00:07 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:00:07 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:00:07 user nova-compute[71330]:   <metadata>
Apr 14 12:00:07 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:00:07 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:00:07 user nova-compute[71330]:       <nova:name>tempest-TestMinimumBasicScenario-server-1398086214</nova:name>
Apr 14 12:00:07 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:00:05</nova:creationTime>
Apr 14 12:00:07 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:00:07 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:00:07 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:00:07 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:00:07 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:00:07 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:00:07 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:00:07 user nova-compute[71330]:       <nova:owner>
Apr 14 12:00:07 user nova-compute[71330]:         <nova:user uuid="2eb32a03e7e04da18568294cca0e69bd">tempest-TestMinimumBasicScenario-881161311-project-member</nova:user>
Apr 14 12:00:07 user nova-compute[71330]:         <nova:project uuid="cd9936aa363942f6a01bb64a8a8e74c9">tempest-TestMinimumBasicScenario-881161311</nova:project>
Apr 14 12:00:07 user nova-compute[71330]:       </nova:owner>
Apr 14 12:00:07 user nova-compute[71330]:       <nova:root type="image" uuid="e352d0f0-b1ad-42b1-b85d-d82679cbae9f"/>
Apr 14 12:00:07 user nova-compute[71330]:       <nova:ports>
Apr 14 12:00:07 user nova-compute[71330]:         <nova:port uuid="1aad7982-a338-4425-9e53-ea99f31b0de6">
Apr 14 12:00:07 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 12:00:07 user nova-compute[71330]:         </nova:port>
Apr 14 12:00:07 user nova-compute[71330]:       </nova:ports>
Apr 14 12:00:07 user nova-compute[71330]:     </nova:instance>
Apr 14 12:00:07 user nova-compute[71330]:   </metadata>
Apr 14 12:00:07 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:00:07 user nova-compute[71330]:     <system>
Apr 14 12:00:07 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:00:07 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:00:07 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:00:07 user nova-compute[71330]:       <entry name="serial">25eda1c2-9b82-412f-b75d-358e87847a29</entry>
Apr 14 12:00:07 user nova-compute[71330]:       <entry name="uuid">25eda1c2-9b82-412f-b75d-358e87847a29</entry>
Apr 14 12:00:07 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:00:07 user nova-compute[71330]:     </system>
Apr 14 12:00:07 user nova-compute[71330]:   </sysinfo>
Apr 14 12:00:07 user nova-compute[71330]:   <os>
Apr 14 12:00:07 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:00:07 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:00:07 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:00:07 user nova-compute[71330]:   </os>
Apr 14 12:00:07 user nova-compute[71330]:   <features>
Apr 14 12:00:07 user nova-compute[71330]:     <acpi/>
Apr 14 12:00:07 user nova-compute[71330]:     <apic/>
Apr 14 12:00:07 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:00:07 user nova-compute[71330]:   </features>
Apr 14 12:00:07 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:00:07 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:00:07 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:00:07 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:00:07 user nova-compute[71330]:   </clock>
Apr 14 12:00:07 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:00:07 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:00:07 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:00:07 user nova-compute[71330]:   </cpu>
Apr 14 12:00:07 user nova-compute[71330]:   <devices>
Apr 14 12:00:07 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:00:07 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:00:07 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk"/>
Apr 14 12:00:07 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:00:07 user nova-compute[71330]:     </disk>
Apr 14 12:00:07 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:00:07 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:00:07 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 12:00:07 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:00:07 user nova-compute[71330]:       <serial>02f6321c-fa2b-4e36-8b89-caffe1df4027</serial>
Apr 14 12:00:07 user nova-compute[71330]:     </disk>
Apr 14 12:00:07 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:00:07 user nova-compute[71330]:       <mac address="fa:16:3e:4f:d4:34"/>
Apr 14 12:00:07 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:00:07 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:00:07 user nova-compute[71330]:       <target dev="tap1aad7982-a3"/>
Apr 14 12:00:07 user nova-compute[71330]:     </interface>
Apr 14 12:00:07 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:00:07 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/console.log" append="off"/>
Apr 14 12:00:07 user nova-compute[71330]:     </serial>
Apr 14 12:00:07 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:00:07 user nova-compute[71330]:     <video>
Apr 14 12:00:07 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:00:07 user nova-compute[71330]:     </video>
Apr 14 12:00:07 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:00:07 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:00:07 user nova-compute[71330]:     </rng>
Apr 14 12:00:07 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:00:07 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:00:07 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:00:07 user nova-compute[71330]:     </memballoon>
Apr 14 12:00:07 user nova-compute[71330]:   </devices>
Apr 14 12:00:07 user nova-compute[71330]: </domain>
Apr 14 12:00:07 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2 --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Cannot resize image /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'migration_context' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1398086214',display_name='tempest-TestMinimumBasicScenario-server-1398086214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1398086214',id=10,image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFIiKeQ/0Z0VfNZ6VUUlM9T5nZwFyI0LyXC8IRlH9W30muvQjtYrEeJ005baAqyTH/3Er2lAxmVvPn8aYg78pz/L256wjoD0MsMUEVdNJFcrEot77mjLycf8/vwxTsgA==',key_name='tempest-TestMinimumBasicScenario-565940781',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='cd9936aa363942f6a01bb64a8a8e74c9',ramdisk_id='',reservation_id='r-awo3v0q9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-881161311',owner_user_name='tempest-TestMinimumBasicScenario-881161311-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:00:05Z,user_data=None,user_id='2eb32a03e7e04da18568294cca0e69bd',uuid=25eda1c2-9b82-412f-b75d-358e87847a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converting VIF {"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG os_vif [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aad7982-a3, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1aad7982-a3, col_values=(('external_ids', {'iface-id': '1aad7982-a338-4425-9e53-ea99f31b0de6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:d4:34', 'vm-uuid': '25eda1c2-9b82-412f-b75d-358e87847a29'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:00:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:07 user nova-compute[71330]: INFO os_vif [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3')
Apr 14 12:00:08 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473593.969836, 132e2ee3-a757-42ef-b0ae-3441dca65da5 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:00:08 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] VM Stopped (Lifecycle Event)
Apr 14 12:00:08 user nova-compute[71330]: DEBUG nova.compute.manager [None req-025aa4e2-0123-43be-8440-0fb0e8fc8c7c None None] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] No waiting events found dispatching network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:00:09 user nova-compute[71330]: WARNING nova.compute.manager [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received unexpected event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 12:00:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 25eda1c2-9b82-412f-b75d-358e87847a29 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473611.5327528, 25eda1c2-9b82-412f-b75d-358e87847a29 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:00:11 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] VM Resumed (Lifecycle Event)
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:00:11 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Instance rebooted successfully.
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.compute.manager [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.compute.manager [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] No waiting events found dispatching network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:00:11 user nova-compute[71330]: WARNING nova.compute.manager [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received unexpected event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:00:11 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473611.5342681, 25eda1c2-9b82-412f-b75d-358e87847a29 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:00:11 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] VM Started (Lifecycle Event)
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.547s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:00:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:00:17 user nova-compute[71330]: INFO nova.compute.claims [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Claim successful on node user
Apr 14 12:00:17 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:00:17 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:00:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG nova.policy [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '390ba60eb6f3478fb8225976ee516218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1dde7a2b6d498cbb829c51bfafadee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:00:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Creating image(s)
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "/opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "/opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "/opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.160s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk 1073741824" returned: 0 in 0.058s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Successfully created port: dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Cannot resize image /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG nova.objects.instance [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'migration_context' on Instance uuid 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Ensure instance console log exists: /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Successfully updated port: dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "refresh_cache-33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquired lock "refresh_cache-33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received event network-changed-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Refreshing instance network info cache due to event network-changed-dccd217a-dfee-484e-a4cd-2d94ba4326ab. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] Acquiring lock "refresh_cache-33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Updating instance_info_cache with network_info: [{"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Releasing lock "refresh_cache-33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Instance network_info: |[{"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] Acquired lock "refresh_cache-33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG nova.network.neutron [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Refreshing network info cache for port dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:00:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Start _get_guest_xml network_info=[{"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:00:20 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:00:20 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1095164094',display_name='tempest-VolumesAdminNegativeTest-server-1095164094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1095164094',id=13,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1dde7a2b6d498cbb829c51bfafadee',ramdisk_id='',reservation_id='r-5jo2ynto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1955614665',owner_user_name='tempest-VolumesAdminNegativeTest-1955614665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:00:18Z,user_data=None,user_id='390ba60eb6f3478fb8225976ee516218',uuid=33c5eb35-5061-43d1-8c9b-fb88b7bc8c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converting VIF {"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3f:9e,bridge_name='br-int',has_traffic_filtering=True,id=dccd217a-dfee-484e-a4cd-2d94ba4326ab,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccd217a-df') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'pci_devices' on Instance uuid 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:00:20 user nova-compute[71330]:   <uuid>33c5eb35-5061-43d1-8c9b-fb88b7bc8c84</uuid>
Apr 14 12:00:20 user nova-compute[71330]:   <name>instance-0000000d</name>
Apr 14 12:00:20 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:00:20 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:00:20 user nova-compute[71330]:   <metadata>
Apr 14 12:00:20 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:00:20 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:00:20 user nova-compute[71330]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1095164094</nova:name>
Apr 14 12:00:20 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:00:20</nova:creationTime>
Apr 14 12:00:20 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:00:20 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:00:20 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:00:20 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:00:20 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:00:20 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:00:20 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:00:20 user nova-compute[71330]:       <nova:owner>
Apr 14 12:00:20 user nova-compute[71330]:         <nova:user uuid="390ba60eb6f3478fb8225976ee516218">tempest-VolumesAdminNegativeTest-1955614665-project-member</nova:user>
Apr 14 12:00:20 user nova-compute[71330]:         <nova:project uuid="8d1dde7a2b6d498cbb829c51bfafadee">tempest-VolumesAdminNegativeTest-1955614665</nova:project>
Apr 14 12:00:20 user nova-compute[71330]:       </nova:owner>
Apr 14 12:00:20 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:00:20 user nova-compute[71330]:       <nova:ports>
Apr 14 12:00:20 user nova-compute[71330]:         <nova:port uuid="dccd217a-dfee-484e-a4cd-2d94ba4326ab">
Apr 14 12:00:20 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 12:00:20 user nova-compute[71330]:         </nova:port>
Apr 14 12:00:20 user nova-compute[71330]:       </nova:ports>
Apr 14 12:00:20 user nova-compute[71330]:     </nova:instance>
Apr 14 12:00:20 user nova-compute[71330]:   </metadata>
Apr 14 12:00:20 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:00:20 user nova-compute[71330]:     <system>
Apr 14 12:00:20 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:00:20 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:00:20 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:00:20 user nova-compute[71330]:       <entry name="serial">33c5eb35-5061-43d1-8c9b-fb88b7bc8c84</entry>
Apr 14 12:00:20 user nova-compute[71330]:       <entry name="uuid">33c5eb35-5061-43d1-8c9b-fb88b7bc8c84</entry>
Apr 14 12:00:20 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:00:20 user nova-compute[71330]:     </system>
Apr 14 12:00:20 user nova-compute[71330]:   </sysinfo>
Apr 14 12:00:20 user nova-compute[71330]:   <os>
Apr 14 12:00:20 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:00:20 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:00:20 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:00:20 user nova-compute[71330]:   </os>
Apr 14 12:00:20 user nova-compute[71330]:   <features>
Apr 14 12:00:20 user nova-compute[71330]:     <acpi/>
Apr 14 12:00:20 user nova-compute[71330]:     <apic/>
Apr 14 12:00:20 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:00:20 user nova-compute[71330]:   </features>
Apr 14 12:00:20 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:00:20 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:00:20 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:00:20 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:00:20 user nova-compute[71330]:   </clock>
Apr 14 12:00:20 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:00:20 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:00:20 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:00:20 user nova-compute[71330]:   </cpu>
Apr 14 12:00:20 user nova-compute[71330]:   <devices>
Apr 14 12:00:20 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:00:20 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:00:20 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk"/>
Apr 14 12:00:20 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:00:20 user nova-compute[71330]:     </disk>
Apr 14 12:00:20 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:00:20 user nova-compute[71330]:       <mac address="fa:16:3e:4c:3f:9e"/>
Apr 14 12:00:20 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:00:20 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:00:20 user nova-compute[71330]:       <target dev="tapdccd217a-df"/>
Apr 14 12:00:20 user nova-compute[71330]:     </interface>
Apr 14 12:00:20 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:00:20 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/console.log" append="off"/>
Apr 14 12:00:20 user nova-compute[71330]:     </serial>
Apr 14 12:00:20 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:00:20 user nova-compute[71330]:     <video>
Apr 14 12:00:20 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:00:20 user nova-compute[71330]:     </video>
Apr 14 12:00:20 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:00:20 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:00:20 user nova-compute[71330]:     </rng>
Apr 14 12:00:20 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:00:20 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:00:20 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:00:20 user nova-compute[71330]:     </memballoon>
Apr 14 12:00:20 user nova-compute[71330]:   </devices>
Apr 14 12:00:20 user nova-compute[71330]: </domain>
Apr 14 12:00:20 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1095164094',display_name='tempest-VolumesAdminNegativeTest-server-1095164094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1095164094',id=13,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1dde7a2b6d498cbb829c51bfafadee',ramdisk_id='',reservation_id='r-5jo2ynto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1955614665',owner_user_name='tempest-VolumesAdminNegativeTest-1955614665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:00:18Z,user_data=None,user_id='390ba60eb6f3478fb8225976ee516218',uuid=33c5eb35-5061-43d1-8c9b-fb88b7bc8c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converting VIF {"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3f:9e,bridge_name='br-int',has_traffic_filtering=True,id=dccd217a-dfee-484e-a4cd-2d94ba4326ab,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccd217a-df') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG os_vif [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3f:9e,bridge_name='br-int',has_traffic_filtering=True,id=dccd217a-dfee-484e-a4cd-2d94ba4326ab,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccd217a-df') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdccd217a-df, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdccd217a-df, col_values=(('external_ids', {'iface-id': 'dccd217a-dfee-484e-a4cd-2d94ba4326ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:3f:9e', 'vm-uuid': '33c5eb35-5061-43d1-8c9b-fb88b7bc8c84'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:20 user nova-compute[71330]: INFO os_vif [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3f:9e,bridge_name='br-int',has_traffic_filtering=True,id=dccd217a-dfee-484e-a4cd-2d94ba4326ab,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccd217a-df')
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] No VIF found with MAC fa:16:3e:4c:3f:9e, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Updated VIF entry in instance network info cache for port dccd217a-dfee-484e-a4cd-2d94ba4326ab. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Updating instance_info_cache with network_info: [{"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] Releasing lock "refresh_cache-33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:00:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received event network-vif-plugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] Acquiring lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] No waiting events found dispatching network-vif-plugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:00:21 user nova-compute[71330]: WARNING nova.compute.manager [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received unexpected event network-vif-plugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance with vm_state building and task_state spawning.
Apr 14 12:00:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:23 user nova-compute[71330]: DEBUG nova.compute.manager [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received event network-vif-plugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] Acquiring lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:23 user nova-compute[71330]: DEBUG nova.compute.manager [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] No waiting events found dispatching network-vif-plugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:00:23 user nova-compute[71330]: WARNING nova.compute.manager [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received unexpected event network-vif-plugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance with vm_state building and task_state spawning.
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473624.1477447, 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:00:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] VM Resumed (Lifecycle Event)
Apr 14 12:00:24 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Instance spawned successfully.
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:00:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473624.1517065, 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:00:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] VM Started (Lifecycle Event)
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:00:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:00:24 user nova-compute[71330]: INFO nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Took 6.22 seconds to spawn the instance on the hypervisor.
Apr 14 12:00:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:00:24 user nova-compute[71330]: INFO nova.compute.manager [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Took 6.99 seconds to build instance.
Apr 14 12:00:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.083s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:45 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:45 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:45 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:00:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 14 12:00:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:00:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:00:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:46 user nova-compute[71330]: INFO nova.compute.manager [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Terminating instance
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating instance_info_cache with network_info: [{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received event network-vif-unplugged-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] No waiting events found dispatching network-vif-unplugged-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received event network-vif-unplugged-c7a8788d-e6ec-4958-8755-b88f421793c3 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:00:46 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Instance destroyed successfully.
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lazy-loading 'resources' on Instance uuid 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-92977634',display_name='tempest-TestVolumeSwap-server-92977634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-92977634',id=9,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNK1h/THvT6cq6N0iVdaxJtF4N+zyijAbwCt203K+qT3+6nOD7jWDcOnyxbv9yde5KURkOBZ+7kcCeoteXvV9dRD/N/+bb1bDR6/Vzy+7NKcyHQueXPA551IaXtV4F3A4Q==',key_name='tempest-keypair-1235067215',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec8170ca28d84853b1e641b5acbb9708',ramdisk_id='',reservation_id='r-eouthc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1357355751',owner_user_name='tempest-TestVolumeSwap-1357355751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:57:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b28366f58e4c6b95d0f9d39ae73fbe',uuid=34c3100c-5b90-47a1-8c3b-fb53467fcd20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Converting VIF {"id": "c7a8788d-e6ec-4958-8755-b88f421793c3", "address": "fa:16:3e:35:b4:c4", "network": {"id": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-96543779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec8170ca28d84853b1e641b5acbb9708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a8788d-e6", "ovs_interfaceid": "c7a8788d-e6ec-4958-8755-b88f421793c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:b4:c4,bridge_name='br-int',has_traffic_filtering=True,id=c7a8788d-e6ec-4958-8755-b88f421793c3,network=Network(0a15f87a-0ea8-4073-a37d-3c81f8de3dc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a8788d-e6') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG os_vif [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:b4:c4,bridge_name='br-int',has_traffic_filtering=True,id=c7a8788d-e6ec-4958-8755-b88f421793c3,network=Network(0a15f87a-0ea8-4073-a37d-3c81f8de3dc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a8788d-e6') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7a8788d-e6, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:00:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:46 user nova-compute[71330]: INFO os_vif [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:b4:c4,bridge_name='br-int',has_traffic_filtering=True,id=c7a8788d-e6ec-4958-8755-b88f421793c3,network=Network(0a15f87a-0ea8-4073-a37d-3c81f8de3dc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a8788d-e6')
Apr 14 12:00:46 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Deleting instance files /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20_del
Apr 14 12:00:46 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Deletion of /opt/stack/data/nova/instances/34c3100c-5b90-47a1-8c3b-fb53467fcd20_del complete
Apr 14 12:00:47 user nova-compute[71330]: INFO nova.compute.manager [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:47 user nova-compute[71330]: INFO nova.compute.manager [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Unshelving
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: INFO nova.virt.block_device [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Booting with volume d60a2fbc-9189-4b30-96ac-16d35138d669 at /dev/vdc
Apr 14 12:00:47 user nova-compute[71330]: DEBUG os_brick.utils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d93f9fe-2478-4e86-b97d-246cab5914d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1781542-5ecd-4dca-8cac-4e026829cdac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b6fd3c-0034-49f4-b15a-56a0638ca2c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fbb848-601d-4317-8f40-c2a33e52210b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:00:47 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a602c0-8fca-439b-9b79-324ece1389cc]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG os_brick.utils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating existing volume attachment record: 51901dd6-294d-4503-b400-82b03072b873 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'flavor' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received event network-vif-deleted-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:48 user nova-compute[71330]: INFO nova.compute.manager [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Neutron deleted interface c7a8788d-e6ec-4958-8755-b88f421793c3; detaching it from the instance and deleting it from the info cache
Apr 14 12:00:48 user nova-compute[71330]: DEBUG nova.network.neutron [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:48 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Took 1.42 seconds to deallocate network for instance.
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:48 user nova-compute[71330]: INFO nova.compute.manager [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Attaching volume d987d86e-92eb-4c3d-a537-909b62392bff to /dev/vdb
Apr 14 12:00:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Detach interface failed, port_id=c7a8788d-e6ec-4958-8755-b88f421793c3, reason: Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG os_brick.utils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76ade61-3f08-4391-a990-b7a29cb93f1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c5b984-f4fc-4da0-95ac-954f0c671b0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a60a310-5477-4a92-84f0-3193284b4361]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[366e7444-f67e-43a4-9078-2cab9fa29530]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:00:48 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf4cbca-7c98-48c0-9721-a78e5bcbf066]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received event network-vif-plugged-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] Acquiring lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] No waiting events found dispatching network-vif-plugged-c7a8788d-e6ec-4958-8755-b88f421793c3 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:00:48 user nova-compute[71330]: WARNING nova.compute.manager [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Received unexpected event network-vif-plugged-c7a8788d-e6ec-4958-8755-b88f421793c3 for instance with vm_state deleted and task_state None.
Apr 14 12:00:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG os_brick.utils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating existing volume attachment record: 88ee4058-3742-41b2-8c3b-128854706ada {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:49 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Deleted allocations for instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:49 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid '34c3100c-5b90-47a1-8c3b-fb53467fcd20' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid '34c3100c-5b90-47a1-8c3b-fb53467fcd20' (instance-00000009)
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "34c3100c-5b90-47a1-8c3b-fb53467fcd20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.207s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:50 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:00:50 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7862MB free_disk=26.436878204345703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 25eda1c2-9b82-412f-b75d-358e87847a29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:00:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "fcd74f51-099e-4c19-af7d-912f622fb153" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:00:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:00:52 user nova-compute[71330]: INFO nova.compute.claims [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Claim successful on node user
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.objects.instance [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'pci_requests' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.objects.instance [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'numa_topology' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:53 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:00:53 user nova-compute[71330]: INFO nova.compute.claims [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Claim successful on node user
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.policy [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:00:53 user nova-compute[71330]: INFO nova.virt.block_device [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Booting with blank volume at /dev/vda
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:00:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:53 user nova-compute[71330]: INFO nova.network.neutron [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating port 7ea071f4-a31f-4eb6-b79b-971106d2c33e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 12:00:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:54 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Successfully created port: a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquired lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG nova.network.neutron [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-changed-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Refreshing instance network info cache due to event network-changed-7ea071f4-a31f-4eb6-b79b-971106d2c33e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] Acquiring lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Successfully updated port: a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquired lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:00:55 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG nova.network.neutron [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating instance_info_cache with network_info: [{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Releasing lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:00:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Creating image(s)
Apr 14 12:00:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG nova.objects.instance [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'trusted_certs' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] Acquired lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG nova.network.neutron [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Refreshing network info cache for port 7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updating instance_info_cache with network_info: [{"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Releasing lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Instance network_info: |[{"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4.part --force-share --output=json" returned: 0 in 0.156s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG nova.virt.images [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 331e9706-c835-4968-9d4f-3f0a9a8400ac was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4.part /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4.part /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4.converted" returned: 0 in 0.262s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-changed-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Refreshing instance network info cache due to event network-changed-a7084b3b-06c3-4e07-99fd-a37260b37f29. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] Acquiring lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] Acquired lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG nova.network.neutron [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Refreshing network info cache for port a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.326s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG nova.network.neutron [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updated VIF entry in instance network info cache for port 7ea071f4-a31f-4eb6-b79b-971106d2c33e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG nova.network.neutron [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating instance_info_cache with network_info: [{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] Releasing lock "refresh_cache-ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4 --force-share --output=json" returned: 0 in 0.159s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:00:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4 --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4,backing_fmt=raw /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4,backing_fmt=raw /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk 1073741824" returned: 0 in 0.054s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4 --force-share --output=json" returned: 0 in 0.150s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG nova.objects.instance [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'migration_context' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:00:58 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Rebasing disk image.
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updated VIF entry in instance network info cache for port a7084b3b-06c3-4e07-99fd-a37260b37f29. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updating instance_info_cache with network_info: [{"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] Releasing lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.176s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e -F raw /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG os_brick.utils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.035s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[45936020-256c-4b3a-9df3-ae48fb8e644f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b34779-7246-4f4f-83de-949531699b3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5deb84a-e73d-4a78-9443-680be306fefe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e77595-7610-435c-9ba5-ab3cbb594132]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:00:59 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ed36f6-aff6-4958-85e5-8829442fe577]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.utils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updating existing volume attachment record: c9d2b452-ead8-43cc-a2dc-90475a9c686c {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYINHwts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:00:59 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:00:59 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:00:59 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[475b5747-a856-438b-b735-cc225b129b6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:00:59 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a72a97-a1c3-400a-9ff2-eb274ef75944]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff] added
Apr 14 12:00:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffa136e-0d6b-4d54-803f-f57c3662ab0c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[26170ca6-507d-4c1f-8c18-4bd80fba435f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYINHwts {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYINHwts" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbed6c6-0991-4d04-a32e-888c7729abf2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYINHwts'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6775fcdf-e2c8-475e-9bd7-356fbdc4ad63]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8923ea96-5b8f-4043-af6e-f3fee8926d38]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:00:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:00:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f559c904-d574-45dc-9b7e-a9aa8b67cfbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff, portal: 172.16.0.220,3260]
Apr 14 12:00:59 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff, portal: 172.16.0.220,3260] successful.
Apr 14 12:00:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c862d8-74fe-4c0c-8965-53d3d34ca9e7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c319eddc-e145-4003-8a8e-c00dc0367e76]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:00:59 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:00:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:00:59 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:00:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c960111f-eefc-41c4-87a3-fab6bd3b2661]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:00:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYINHwts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23431343162393231', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431343162393231', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.objects.instance [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'flavor' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:01:00 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:01:00 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:01:00 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:01:00 user nova-compute[71330]:   <serial>d987d86e-92eb-4c3d-a537-909b62392bff</serial>
Apr 14 12:01:00 user nova-compute[71330]: </disk>
Apr 14 12:01:00 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e -F raw /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk" returned: 0 in 2.421s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Ensure instance console log exists: /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Start _get_guest_xml network_info=[{"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='51ab20ea7fdffcde9658927759bdf220',container_format='bare',created_at=2023-04-14T11:58:55Z,direct_url=<?>,disk_format='qcow2',id=331e9706-c835-4968-9d4f-3f0a9a8400ac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1373523786-shelved',owner='cc13fb093d2745e8ba0152533140b6f2',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T11:59:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '51901dd6-294d-4503-b400-82b03072b873', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkZBiHbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ad7c2f89-c54f-4e78-b86d-88b4ab5daff4', 'attached_at': '', 'detached_at': '', 'volume_id': 'd60a2fbc-9189-4b30-96ac-16d35138d669', 'serial': 'd60a2fbc-9189-4b30-96ac-16d35138d669'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:01:00 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:00 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='51ab20ea7fdffcde9658927759bdf220',container_format='bare',created_at=2023-04-14T11:58:55Z,direct_url=<?>,disk_format='qcow2',id=331e9706-c835-4968-9d4f-3f0a9a8400ac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1373523786-shelved',owner='cc13fb093d2745e8ba0152533140b6f2',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T11:59:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.objects.instance [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkZBiHbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:01:00 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:01:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:01:00 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:01:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:01:00 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:01:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0948c519-189a-4dc5-914a-9f914e25e753]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:01:01 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6656caa9-e27e-4654-9b5c-8243b694f72f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669] added
Apr 14 12:01:01 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc3cff5-e8d0-441a-ade0-40dfa23397a5]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ec989-5e6a-4bdb-8b63-73b40f05a33b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkZBiHbe {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkZBiHbe" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a422c7d-f651-48bd-9106-dd2f6602f70f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NkZBiHbe'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292f53a-b69d-49d4-9816-48ffc8e6f97e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e245a4-e234-4659-87a2-6ff904dbc70d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:01 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:01 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:01 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:01 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33956ba-af02-47db-8799-e4e38f4b2bb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669, portal: 172.16.0.220,3260]
Apr 14 12:01:01 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669, portal: 172.16.0.220,3260] successful.
Apr 14 12:01:01 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[34224130-310d-47e3-8a78-4aa033dbaf4a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b578fd-a0c1-4c93-aa9a-ac44d66dcccc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:01 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:01 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:01 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:01 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:01 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:01 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] No VIF found with MAC fa:16:3e:b7:fb:9f, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[05be5c27-5fc1-4834-bf32-d7aae993d019]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:01:01 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkZBiHbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473646.9052124, 34c3100c-5b90-47a1-8c3b-fb53467fcd20 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:02 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] VM Stopped (Lifecycle Event)
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c8151a90-a58f-494c-beee-c4eea54f6b47 None None] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.855s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23565663036313164', 'path': '/dev/sdd'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565663036313164', 'path': '/dev/sdd'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T11:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373523786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373523786',id=4,image_ref='331e9706-c835-4968-9d4f-3f0a9a8400ac',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1689899826',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-fmqjkid5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member',shelved_at='2023-04-14T11:59:01.057841',shelved_host='user',shelved_image_id='331e9706-c835-4968-9d4f-3f0a9a8400ac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=ad7c2f89-c54f-4e78-b86d-88b4ab5daff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.objects.instance [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'pci_devices' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:01:02 user nova-compute[71330]:   <uuid>ad7c2f89-c54f-4e78-b86d-88b4ab5daff4</uuid>
Apr 14 12:01:02 user nova-compute[71330]:   <name>instance-00000004</name>
Apr 14 12:01:02 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:01:02 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:01:02 user nova-compute[71330]:   <metadata>
Apr 14 12:01:02 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:01:02 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:01:02 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1373523786</nova:name>
Apr 14 12:01:02 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:01:00</nova:creationTime>
Apr 14 12:01:02 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:01:02 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:01:02 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:01:02 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:01:02 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:01:02 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:01:02 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:01:02 user nova-compute[71330]:       <nova:owner>
Apr 14 12:01:02 user nova-compute[71330]:         <nova:user uuid="260d1d4ef5a1422f84f9d91224b53952">tempest-AttachVolumeShelveTestJSON-1457966394-project-member</nova:user>
Apr 14 12:01:02 user nova-compute[71330]:         <nova:project uuid="cc13fb093d2745e8ba0152533140b6f2">tempest-AttachVolumeShelveTestJSON-1457966394</nova:project>
Apr 14 12:01:02 user nova-compute[71330]:       </nova:owner>
Apr 14 12:01:02 user nova-compute[71330]:       <nova:root type="image" uuid="331e9706-c835-4968-9d4f-3f0a9a8400ac"/>
Apr 14 12:01:02 user nova-compute[71330]:       <nova:ports>
Apr 14 12:01:02 user nova-compute[71330]:         <nova:port uuid="7ea071f4-a31f-4eb6-b79b-971106d2c33e">
Apr 14 12:01:02 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 12:01:02 user nova-compute[71330]:         </nova:port>
Apr 14 12:01:02 user nova-compute[71330]:       </nova:ports>
Apr 14 12:01:02 user nova-compute[71330]:     </nova:instance>
Apr 14 12:01:02 user nova-compute[71330]:   </metadata>
Apr 14 12:01:02 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:01:02 user nova-compute[71330]:     <system>
Apr 14 12:01:02 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:01:02 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:01:02 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:01:02 user nova-compute[71330]:       <entry name="serial">ad7c2f89-c54f-4e78-b86d-88b4ab5daff4</entry>
Apr 14 12:01:02 user nova-compute[71330]:       <entry name="uuid">ad7c2f89-c54f-4e78-b86d-88b4ab5daff4</entry>
Apr 14 12:01:02 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:01:02 user nova-compute[71330]:     </system>
Apr 14 12:01:02 user nova-compute[71330]:   </sysinfo>
Apr 14 12:01:02 user nova-compute[71330]:   <os>
Apr 14 12:01:02 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:01:02 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:01:02 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:01:02 user nova-compute[71330]:   </os>
Apr 14 12:01:02 user nova-compute[71330]:   <features>
Apr 14 12:01:02 user nova-compute[71330]:     <acpi/>
Apr 14 12:01:02 user nova-compute[71330]:     <apic/>
Apr 14 12:01:02 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:01:02 user nova-compute[71330]:   </features>
Apr 14 12:01:02 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:01:02 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:01:02 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:01:02 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:01:02 user nova-compute[71330]:   </clock>
Apr 14 12:01:02 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:01:02 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:01:02 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:01:02 user nova-compute[71330]:   </cpu>
Apr 14 12:01:02 user nova-compute[71330]:   <devices>
Apr 14 12:01:02 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:01:02 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:01:02 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk"/>
Apr 14 12:01:02 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:01:02 user nova-compute[71330]:     </disk>
Apr 14 12:01:02 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:01:02 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:01:02 user nova-compute[71330]:       <source dev="/dev/sdd"/>
Apr 14 12:01:02 user nova-compute[71330]:       <target dev="vdc" bus="virtio"/>
Apr 14 12:01:02 user nova-compute[71330]:       <serial>d60a2fbc-9189-4b30-96ac-16d35138d669</serial>
Apr 14 12:01:02 user nova-compute[71330]:     </disk>
Apr 14 12:01:02 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:01:02 user nova-compute[71330]:       <mac address="fa:16:3e:19:43:63"/>
Apr 14 12:01:02 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:02 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:01:02 user nova-compute[71330]:       <target dev="tap7ea071f4-a3"/>
Apr 14 12:01:02 user nova-compute[71330]:     </interface>
Apr 14 12:01:02 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:01:02 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/console.log" append="off"/>
Apr 14 12:01:02 user nova-compute[71330]:     </serial>
Apr 14 12:01:02 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:01:02 user nova-compute[71330]:     <video>
Apr 14 12:01:02 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:02 user nova-compute[71330]:     </video>
Apr 14 12:01:02 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:01:02 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:01:02 user nova-compute[71330]:     </rng>
Apr 14 12:01:02 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:01:02 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:01:02 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:01:02 user nova-compute[71330]:     </memballoon>
Apr 14 12:01:02 user nova-compute[71330]:   </devices>
Apr 14 12:01:02 user nova-compute[71330]: </domain>
Apr 14 12:01:02 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T11:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373523786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373523786',id=4,image_ref='331e9706-c835-4968-9d4f-3f0a9a8400ac',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1689899826',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-fmqjkid5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member',shelved_at='2023-04-14T11:59:01.057841',shelved_host='user',shelved_image_id='331e9706-c835-4968-9d4f-3f0a9a8400ac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=ad7c2f89-c54f-4e78-b86d-88b4ab5daff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG os_vif [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ea071f4-a3, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ea071f4-a3, col_values=(('external_ids', {'iface-id': '7ea071f4-a31f-4eb6-b79b-971106d2c33e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:43:63', 'vm-uuid': 'ad7c2f89-c54f-4e78-b86d-88b4ab5daff4'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:02 user nova-compute[71330]: INFO os_vif [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3')
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] No VIF found with MAC fa:16:3e:19:43:63, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:01:02 user nova-compute[71330]: INFO nova.compute.manager [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Rescuing
Apr 14 12:01:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquired lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:01:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:01:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating instance_info_cache with network_info: [{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Releasing lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] No waiting events found dispatching network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:04 user nova-compute[71330]: WARNING nova.compute.manager [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received unexpected event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 12:01:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-unplugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-unplugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:04 user nova-compute[71330]: WARNING nova.compute.manager [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-unplugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state active and task_state rescuing.
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:05 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Instance destroyed successfully.
Apr 14 12:01:05 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Attempting a stable device rescue
Apr 14 12:01:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71330) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 12:01:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Instance directory exists: not creating {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 12:01:05 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Creating image(s)
Apr 14 12:01:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:05 user nova-compute[71330]: DEBUG nova.objects.instance [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "9d26789fb9d41283d19eaa0472899ccd9afbe389" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "9d26789fb9d41283d19eaa0472899ccd9afbe389" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389.part --force-share --output=json" returned: 0 in 0.244s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG nova.virt.images [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] d4a621c0-2cd8-43d1-9ce1-86953bcc79e9 was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389.part /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] No waiting events found dispatching network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:06 user nova-compute[71330]: WARNING nova.compute.manager [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received unexpected event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389.part /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389.converted" returned: 0 in 0.196s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:06 user nova-compute[71330]: WARNING nova.compute.manager [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state active and task_state rescuing.
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "9d26789fb9d41283d19eaa0472899ccd9afbe389" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.644s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "9d26789fb9d41283d19eaa0472899ccd9afbe389" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "9d26789fb9d41283d19eaa0472899ccd9afbe389" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389 --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389,backing_fmt=raw /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389,backing_fmt=raw /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue" returned: 0 in 0.056s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "9d26789fb9d41283d19eaa0472899ccd9afbe389" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'migration_context' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Start _get_guest_xml network_info=[{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "vif_mac": "fa:16:3e:b7:fb:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd4a621c0-2cd8-43d1-9ce1-86953bcc79e9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '88ee4058-3742-41b2-8c3b-128854706ada', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYINHwts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '80b9c47d-7dc8-4bbe-b961-41921a457d98', 'attached_at': '', 'detached_at': '', 'volume_id': 'd987d86e-92eb-4c3d-a537-909b62392bff', 'serial': 'd987d86e-92eb-4c3d-a537-909b62392bff'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'resources' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473667.0850542, ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:07 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] VM Resumed (Lifecycle Event)
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'numa_topology' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:07 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance spawned successfully.
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:07 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:07 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:07 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473667.0922472, ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:07 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] VM Started (Lifecycle Event)
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYINHwts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:01:07 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:01:07 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:01:07 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77e2abd-ac9c-4d18-a013-410c53b30c00]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eYINHwts\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 12:01:07 user nova-compute[71330]: node.name = iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff
Apr 14 12:01:07 user nova-compute[71330]: node.tpgt = -1
Apr 14 12:01:07 user nova-compute[71330]: node.startup = automatic
Apr 14 12:01:07 user nova-compute[71330]: node.leading_login = No
Apr 14 12:01:07 user nova-compute[71330]: iface.iscsi_ifacename = default
Apr 14 12:01:07 user nova-compute[71330]: iface.net_ifacename = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.ipaddress = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.prefix_len = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.hwaddress = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.transport_name = tcp
Apr 14 12:01:07 user nova-compute[71330]: iface.initiatorname = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.state = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.vlan_id = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.vlan_priority = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.vlan_state = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.iface_num = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.mtu = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.port = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.bootproto = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.subnet_mask = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.gateway = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.dhcp_alt_client_id = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.dhcp_dns = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.dhcp_learn_iqn = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.dhcp_vendor_id_state = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.dhcp_vendor_id = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.dhcp_slp_da = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.fragmentation = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.gratuitous_arp = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.incoming_forwarding = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.tos_state = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.tos = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.ttl = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.delayed_ack = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.tcp_nagle = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.tcp_wsf_state = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.tcp_wsf = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.tcp_timer_scale = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.tcp_timestamp = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.redirect = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.def_task_mgmt_timeout = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.header_digest = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.data_digest = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.immediate_data = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.initial_r2t = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.data_seq_inorder = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.data_pdu_inorder = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.erl = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.max_receive_data_len = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.first_burst_len = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.max_outstanding_r2t = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.max_burst_len = 0
Apr 14 12:01:07 user nova-compute[71330]: iface.chap_auth = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.bidi_chap = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.strict_login_compliance = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.discovery_auth = <empty>
Apr 14 12:01:07 user nova-compute[71330]: iface.discovery_logout = <empty>
Apr 14 12:01:07 user nova-compute[71330]: node.discovery_address = <empty>
Apr 14 12:01:07 user nova-compute[71330]: node.discovery_port = 0
Apr 14 12:01:07 user nova-compute[71330]: node.discovery_type = static
Apr 14 12:01:07 user nova-compute[71330]: node.session.initial_cmdsn = 0
Apr 14 12:01:07 user nova-compute[71330]: node.session.initial_login_retry_max = 8
Apr 14 12:01:07 user nova-compute[71330]: node.session.xmit_thread_priority = -20
Apr 14 12:01:07 user nova-compute[71330]: node.session.cmds_max = 128
Apr 14 12:01:07 user nova-compute[71330]: node.session.queue_depth = 32
Apr 14 12:01:07 user nova-compute[71330]: node.session.nr_sessions = 1
Apr 14 12:01:07 user nova-compute[71330]: node.session.auth.authmethod = CHAP
Apr 14 12:01:07 user nova-compute[71330]: node.session.auth.username = eYINHwts
Apr 14 12:01:07 user nova-compute[71330]: node.session.auth.password = ***
Apr 14 12:01:07 user nova-compute[71330]: node.session.auth.username_in = <empty>
Apr 14 12:01:07 user nova-compute[71330]: node.session.auth.password_in = <empty>
Apr 14 12:01:07 user nova-compute[71330]: node.session.auth.chap_algs = MD5
Apr 14 12:01:07 user nova-compute[71330]: node.session.timeo.replacement_timeout = 120
Apr 14 12:01:07 user nova-compute[71330]: node.session.err_timeo.abort_timeout = 15
Apr 14 12:01:07 user nova-compute[71330]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 12:01:07 user nova-compute[71330]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 12:01:07 user nova-compute[71330]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.FastAbort = Yes
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.InitialR2T = No
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.ImmediateData = Yes
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.MaxConnections = 1
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 12:01:07 user nova-compute[71330]: node.session.iscsi.ERL = 0
Apr 14 12:01:07 user nova-compute[71330]: node.session.scan = manual
Apr 14 12:01:07 user nova-compute[71330]: node.session.reopen_max = 0
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].address = 172.16.0.220
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].port = 3260
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].startup = manual
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].tcp.window_size = 524288
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].tcp.type_of_service = 0
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].timeo.logout_timeout = 15
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].timeo.login_timeout = 15
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].timeo.auth_timeout = 45
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].iscsi.DataDigest = None
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].iscsi.IFMarker = No
Apr 14 12:01:07 user nova-compute[71330]: node.conn[0].iscsi.OFMarker = No
Apr 14 12:01:07 user nova-compute[71330]: # END RECORD
Apr 14 12:01:07 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:07 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef30c87c-460c-4e6c-8141-40bfd35b11ee]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcfde48-0f6c-4e87-b4f4-2338884c869a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYINHwts {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYINHwts" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba856c74-5c1c-4b90-be3c-43326ef66313]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYINHwts'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6257b308-c0e7-4ffc-9fb4-22dea2249e20]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a97c744-72c5-4459-b922-073cff92ac60]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:07 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:07 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:07 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:07 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:07 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:07 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.202s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d158714-9375-457c-bd8c-a128d23a6d4c]: (4, ('0 0 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYINHwts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.238s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] <== connect_volume: return (240ms) {'type': 'block', 'scsi_wwn': '23431343162393231', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431343162393231', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1793780522',display_name='tempest-ServerStableDeviceRescueTest-server-1793780522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1793780522',id=5,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXuDQX5mdlneSOlaQfy+4JxDU0auroTMJCiqenRoOw2yfCd/60N23lq489zSoPdy+CApif7xFXMGBg0JnCYtsNCRaca1mNN0lFB5bW9+TQVJK0zLh1rtz82y9q/SaEasg==',key_name='tempest-keypair-438477400',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b3564d4d9634e469520a3deebe14ab6',ramdisk_id='',reservation_id='r-p9k52wkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1361865083',owner_user_name='tempest-ServerStableDeviceRescueTest-1361865083-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:59:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2c1e52acc8496f8f56c82fbce51105',uuid=80b9c47d-7dc8-4bbe-b961-41921a457d98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "vif_mac": "fa:16:3e:b7:fb:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Converting VIF {"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "vif_mac": "fa:16:3e:b7:fb:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:fb:9f,bridge_name='br-int',has_traffic_filtering=True,id=00a245fe-c22c-48a0-9718-72e81d0ef026,network=Network(f01a9b31-3529-47ab-bd37-1b80abdf9e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a245fe-c2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'pci_devices' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:01:07 user nova-compute[71330]:   <uuid>80b9c47d-7dc8-4bbe-b961-41921a457d98</uuid>
Apr 14 12:01:07 user nova-compute[71330]:   <name>instance-00000005</name>
Apr 14 12:01:07 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:01:07 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:01:07 user nova-compute[71330]:   <metadata>
Apr 14 12:01:07 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:01:07 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:01:07 user nova-compute[71330]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1793780522</nova:name>
Apr 14 12:01:07 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:01:07</nova:creationTime>
Apr 14 12:01:07 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:01:07 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:01:07 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:01:07 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:01:07 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:01:07 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:01:07 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:01:07 user nova-compute[71330]:       <nova:owner>
Apr 14 12:01:07 user nova-compute[71330]:         <nova:user uuid="6b2c1e52acc8496f8f56c82fbce51105">tempest-ServerStableDeviceRescueTest-1361865083-project-member</nova:user>
Apr 14 12:01:07 user nova-compute[71330]:         <nova:project uuid="1b3564d4d9634e469520a3deebe14ab6">tempest-ServerStableDeviceRescueTest-1361865083</nova:project>
Apr 14 12:01:07 user nova-compute[71330]:       </nova:owner>
Apr 14 12:01:07 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:01:07 user nova-compute[71330]:       <nova:ports>
Apr 14 12:01:07 user nova-compute[71330]:         <nova:port uuid="00a245fe-c22c-48a0-9718-72e81d0ef026">
Apr 14 12:01:07 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 12:01:07 user nova-compute[71330]:         </nova:port>
Apr 14 12:01:07 user nova-compute[71330]:       </nova:ports>
Apr 14 12:01:07 user nova-compute[71330]:     </nova:instance>
Apr 14 12:01:07 user nova-compute[71330]:   </metadata>
Apr 14 12:01:07 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:01:07 user nova-compute[71330]:     <system>
Apr 14 12:01:07 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:01:07 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:01:07 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:01:07 user nova-compute[71330]:       <entry name="serial">80b9c47d-7dc8-4bbe-b961-41921a457d98</entry>
Apr 14 12:01:07 user nova-compute[71330]:       <entry name="uuid">80b9c47d-7dc8-4bbe-b961-41921a457d98</entry>
Apr 14 12:01:07 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:01:07 user nova-compute[71330]:     </system>
Apr 14 12:01:07 user nova-compute[71330]:   </sysinfo>
Apr 14 12:01:07 user nova-compute[71330]:   <os>
Apr 14 12:01:07 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:01:07 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:01:07 user nova-compute[71330]:   </os>
Apr 14 12:01:07 user nova-compute[71330]:   <features>
Apr 14 12:01:07 user nova-compute[71330]:     <acpi/>
Apr 14 12:01:07 user nova-compute[71330]:     <apic/>
Apr 14 12:01:07 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:01:07 user nova-compute[71330]:   </features>
Apr 14 12:01:07 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:01:07 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:01:07 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:01:07 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:01:07 user nova-compute[71330]:   </clock>
Apr 14 12:01:07 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:01:07 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:01:07 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:01:07 user nova-compute[71330]:   </cpu>
Apr 14 12:01:07 user nova-compute[71330]:   <devices>
Apr 14 12:01:07 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:01:07 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:01:07 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk"/>
Apr 14 12:01:07 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:01:07 user nova-compute[71330]:     </disk>
Apr 14 12:01:07 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:01:07 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:01:07 user nova-compute[71330]:       <source dev="/dev/sdc"/>
Apr 14 12:01:07 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:01:07 user nova-compute[71330]:       <serial>d987d86e-92eb-4c3d-a537-909b62392bff</serial>
Apr 14 12:01:07 user nova-compute[71330]:     </disk>
Apr 14 12:01:07 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:01:07 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:01:07 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue"/>
Apr 14 12:01:07 user nova-compute[71330]:       <target dev="vdc" bus="virtio"/>
Apr 14 12:01:07 user nova-compute[71330]:       <boot order="1"/>
Apr 14 12:01:07 user nova-compute[71330]:     </disk>
Apr 14 12:01:07 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:01:07 user nova-compute[71330]:       <mac address="fa:16:3e:b7:fb:9f"/>
Apr 14 12:01:07 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:07 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:01:07 user nova-compute[71330]:       <target dev="tap00a245fe-c2"/>
Apr 14 12:01:07 user nova-compute[71330]:     </interface>
Apr 14 12:01:07 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:01:07 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/console.log" append="off"/>
Apr 14 12:01:07 user nova-compute[71330]:     </serial>
Apr 14 12:01:07 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:01:07 user nova-compute[71330]:     <video>
Apr 14 12:01:07 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:07 user nova-compute[71330]:     </video>
Apr 14 12:01:07 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:01:07 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:01:07 user nova-compute[71330]:     </rng>
Apr 14 12:01:07 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:01:07 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:01:07 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:01:07 user nova-compute[71330]:     </memballoon>
Apr 14 12:01:07 user nova-compute[71330]:   </devices>
Apr 14 12:01:07 user nova-compute[71330]: </domain>
Apr 14 12:01:07 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.114s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:07 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Instance destroyed successfully.
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] No VIF found with MAC fa:16:3e:b7:fb:9f, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:01:08 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Creating image(s)
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Ensure instance console log exists: /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Start _get_guest_xml network_info=[{"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'c9d2b452-ead8-43cc-a2dc-90475a9c686c', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHwghBUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fcd74f51-099e-4c19-af7d-912f622fb153', 'attached_at': '', 'detached_at': '', 'volume_id': '46c09b71-b72b-49b5-89f7-d78ad27fd426', 'serial': '46c09b71-b72b-49b5-89f7-d78ad27fd426'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:01:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHwghBUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:01:08 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:01:08 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:01:08 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26908f3-35e5-4676-846c-8727c997aef1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:01:08 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e402841-f525-4c57-96f4-7321cc21644f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426] added
Apr 14 12:01:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1688f826-d5d0-492a-851d-d8e4ad495f9b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b5cccd-a677-4213-a41b-afafbbb0b98f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHwghBUj {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHwghBUj" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91acc16-aec4-4746-83c8-b3384262d725]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tHwghBUj'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6abdee0-27c3-4dfd-9482-fc916e84f667]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af3c821-e9bf-4183-b598-bcf0e2fb96fd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a7956c-8504-4fa8-88da-6de3a32856d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426, portal: 172.16.0.220,3260]
Apr 14 12:01:08 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426, portal: 172.16.0.220,3260] successful.
Apr 14 12:01:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee3d012-e426-406e-a9db-b441a1f47482]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b235a8d3-4464-4027-bc31-caa808dcfa6c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:01:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0666460-17a6-4b97-9924-086b388e138c]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:08 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:09 user nova-compute[71330]: WARNING nova.compute.manager [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state active and task_state rescuing.
Apr 14 12:01:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHwghBUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26662343332323561', 'path': '/dev/sde'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662343332323561', 'path': '/dev/sde'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-378271548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-378271548',id=14,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-66dlqwhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:00:53Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=fcd74f51-099e-4c19-af7d-912f622fb153,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=a7084b3b-06c3-4e07-99fd-a37260b37f29,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7084b3b-06') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'pci_devices' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:01:09 user nova-compute[71330]:   <uuid>fcd74f51-099e-4c19-af7d-912f622fb153</uuid>
Apr 14 12:01:09 user nova-compute[71330]:   <name>instance-0000000e</name>
Apr 14 12:01:09 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:01:09 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:01:09 user nova-compute[71330]:   <metadata>
Apr 14 12:01:09 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:01:09 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:01:09 user nova-compute[71330]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-378271548</nova:name>
Apr 14 12:01:09 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:01:08</nova:creationTime>
Apr 14 12:01:09 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:01:09 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:01:09 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:01:09 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:01:09 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:01:09 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:01:09 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:01:09 user nova-compute[71330]:       <nova:owner>
Apr 14 12:01:09 user nova-compute[71330]:         <nova:user uuid="11df88c60e4b456691d8731fe8facf38">tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member</nova:user>
Apr 14 12:01:09 user nova-compute[71330]:         <nova:project uuid="2c5140d4419e43be941c2ac5d5439e35">tempest-ServerBootFromVolumeStableRescueTest-1565599676</nova:project>
Apr 14 12:01:09 user nova-compute[71330]:       </nova:owner>
Apr 14 12:01:09 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:01:09 user nova-compute[71330]:       <nova:ports>
Apr 14 12:01:09 user nova-compute[71330]:         <nova:port uuid="a7084b3b-06c3-4e07-99fd-a37260b37f29">
Apr 14 12:01:09 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 12:01:09 user nova-compute[71330]:         </nova:port>
Apr 14 12:01:09 user nova-compute[71330]:       </nova:ports>
Apr 14 12:01:09 user nova-compute[71330]:     </nova:instance>
Apr 14 12:01:09 user nova-compute[71330]:   </metadata>
Apr 14 12:01:09 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:01:09 user nova-compute[71330]:     <system>
Apr 14 12:01:09 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:01:09 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:01:09 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:01:09 user nova-compute[71330]:       <entry name="serial">fcd74f51-099e-4c19-af7d-912f622fb153</entry>
Apr 14 12:01:09 user nova-compute[71330]:       <entry name="uuid">fcd74f51-099e-4c19-af7d-912f622fb153</entry>
Apr 14 12:01:09 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:01:09 user nova-compute[71330]:     </system>
Apr 14 12:01:09 user nova-compute[71330]:   </sysinfo>
Apr 14 12:01:09 user nova-compute[71330]:   <os>
Apr 14 12:01:09 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:01:09 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:01:09 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:01:09 user nova-compute[71330]:   </os>
Apr 14 12:01:09 user nova-compute[71330]:   <features>
Apr 14 12:01:09 user nova-compute[71330]:     <acpi/>
Apr 14 12:01:09 user nova-compute[71330]:     <apic/>
Apr 14 12:01:09 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:01:09 user nova-compute[71330]:   </features>
Apr 14 12:01:09 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:01:09 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:01:09 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:01:09 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:01:09 user nova-compute[71330]:   </clock>
Apr 14 12:01:09 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:01:09 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:01:09 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:01:09 user nova-compute[71330]:   </cpu>
Apr 14 12:01:09 user nova-compute[71330]:   <devices>
Apr 14 12:01:09 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:01:09 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:01:09 user nova-compute[71330]:       <source dev="/dev/sde"/>
Apr 14 12:01:09 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:01:09 user nova-compute[71330]:       <serial>46c09b71-b72b-49b5-89f7-d78ad27fd426</serial>
Apr 14 12:01:09 user nova-compute[71330]:     </disk>
Apr 14 12:01:09 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:01:09 user nova-compute[71330]:       <mac address="fa:16:3e:75:f4:77"/>
Apr 14 12:01:09 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:09 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:01:09 user nova-compute[71330]:       <target dev="tapa7084b3b-06"/>
Apr 14 12:01:09 user nova-compute[71330]:     </interface>
Apr 14 12:01:09 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:01:09 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/console.log" append="off"/>
Apr 14 12:01:09 user nova-compute[71330]:     </serial>
Apr 14 12:01:09 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:01:09 user nova-compute[71330]:     <video>
Apr 14 12:01:09 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:09 user nova-compute[71330]:     </video>
Apr 14 12:01:09 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:01:09 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:01:09 user nova-compute[71330]:     </rng>
Apr 14 12:01:09 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:01:09 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:01:09 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:01:09 user nova-compute[71330]:     </memballoon>
Apr 14 12:01:09 user nova-compute[71330]:   </devices>
Apr 14 12:01:09 user nova-compute[71330]: </domain>
Apr 14 12:01:09 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-378271548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-378271548',id=14,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-66dlqwhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:00:53Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=fcd74f51-099e-4c19-af7d-912f622fb153,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=a7084b3b-06c3-4e07-99fd-a37260b37f29,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7084b3b-06') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG os_vif [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=a7084b3b-06c3-4e07-99fd-a37260b37f29,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7084b3b-06') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7084b3b-06, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7084b3b-06, col_values=(('external_ids', {'iface-id': 'a7084b3b-06c3-4e07-99fd-a37260b37f29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:f4:77', 'vm-uuid': 'fcd74f51-099e-4c19-af7d-912f622fb153'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:09 user nova-compute[71330]: INFO os_vif [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=a7084b3b-06c3-4e07-99fd-a37260b37f29,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7084b3b-06')
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No VIF found with MAC fa:16:3e:75:f4:77, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:01:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:11 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:11 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:11 user nova-compute[71330]: WARNING nova.compute.manager [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state active and task_state rescuing.
Apr 14 12:01:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 80b9c47d-7dc8-4bbe-b961-41921a457d98 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:01:12 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473672.1282868, 80b9c47d-7dc8-4bbe-b961-41921a457d98 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:12 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] VM Resumed (Lifecycle Event)
Apr 14 12:01:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:12 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 12:01:12 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473672.131048, 80b9c47d-7dc8-4bbe-b961-41921a457d98 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:12 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] VM Started (Lifecycle Event)
Apr 14 12:01:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:13 user nova-compute[71330]: WARNING nova.compute.manager [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state building and task_state spawning.
Apr 14 12:01:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:13 user nova-compute[71330]: WARNING nova.compute.manager [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state building and task_state spawning.
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473674.13135, fcd74f51-099e-4c19-af7d-912f622fb153 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:14 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] VM Resumed (Lifecycle Event)
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:01:14 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Instance spawned successfully.
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:14 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473674.1353033, fcd74f51-099e-4c19-af7d-912f622fb153 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:14 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] VM Started (Lifecycle Event)
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:14 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:01:14 user nova-compute[71330]: INFO nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Took 6.17 seconds to spawn the instance on the hypervisor.
Apr 14 12:01:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:14 user nova-compute[71330]: INFO nova.compute.manager [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Took 21.79 seconds to build instance.
Apr 14 12:01:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "fcd74f51-099e-4c19-af7d-912f622fb153" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.890s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:01:25 user nova-compute[71330]: INFO nova.compute.claims [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Claim successful on node user
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:01:25 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.policy [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:01:25 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Creating image(s)
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.165s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk 1073741824" returned: 0 in 0.054s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.150s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Cannot resize image /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'migration_context' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Ensure instance console log exists: /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:26 user nova-compute[71330]: DEBUG nova.network.neutron [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Successfully created port: d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Successfully updated port: d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-changed-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Refreshing instance network info cache due to event network-changed-d7cd0790-d778-4855-b7ad-c0b5c0258c1b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] Acquiring lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance network_info: |[{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] Acquired lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.network.neutron [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Refreshing network info cache for port d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Start _get_guest_xml network_info=[{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:01:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-523755696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'pci_devices' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:01:27 user nova-compute[71330]:   <uuid>11e4aa91-7c03-46cc-8610-78f18bbd089f</uuid>
Apr 14 12:01:27 user nova-compute[71330]:   <name>instance-0000000f</name>
Apr 14 12:01:27 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:01:27 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:01:27 user nova-compute[71330]:   <metadata>
Apr 14 12:01:27 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:01:27 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:01:27 user nova-compute[71330]:       <nova:name>tempest-ServerActionsTestJSON-server-523755696</nova:name>
Apr 14 12:01:27 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:01:27</nova:creationTime>
Apr 14 12:01:27 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:01:27 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:01:27 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:01:27 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:01:27 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:01:27 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:01:27 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:01:27 user nova-compute[71330]:       <nova:owner>
Apr 14 12:01:27 user nova-compute[71330]:         <nova:user uuid="7e264a59ff9b42e08095d0ce71e4d627">tempest-ServerActionsTestJSON-1592133549-project-member</nova:user>
Apr 14 12:01:27 user nova-compute[71330]:         <nova:project uuid="3e4ff63247dd4535bcd86acfde76fd34">tempest-ServerActionsTestJSON-1592133549</nova:project>
Apr 14 12:01:27 user nova-compute[71330]:       </nova:owner>
Apr 14 12:01:27 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:01:27 user nova-compute[71330]:       <nova:ports>
Apr 14 12:01:27 user nova-compute[71330]:         <nova:port uuid="d7cd0790-d778-4855-b7ad-c0b5c0258c1b">
Apr 14 12:01:27 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 12:01:27 user nova-compute[71330]:         </nova:port>
Apr 14 12:01:27 user nova-compute[71330]:       </nova:ports>
Apr 14 12:01:27 user nova-compute[71330]:     </nova:instance>
Apr 14 12:01:27 user nova-compute[71330]:   </metadata>
Apr 14 12:01:27 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:01:27 user nova-compute[71330]:     <system>
Apr 14 12:01:27 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:01:27 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:01:27 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:01:27 user nova-compute[71330]:       <entry name="serial">11e4aa91-7c03-46cc-8610-78f18bbd089f</entry>
Apr 14 12:01:27 user nova-compute[71330]:       <entry name="uuid">11e4aa91-7c03-46cc-8610-78f18bbd089f</entry>
Apr 14 12:01:27 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:01:27 user nova-compute[71330]:     </system>
Apr 14 12:01:27 user nova-compute[71330]:   </sysinfo>
Apr 14 12:01:27 user nova-compute[71330]:   <os>
Apr 14 12:01:27 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:01:27 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:01:27 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:01:27 user nova-compute[71330]:   </os>
Apr 14 12:01:27 user nova-compute[71330]:   <features>
Apr 14 12:01:27 user nova-compute[71330]:     <acpi/>
Apr 14 12:01:27 user nova-compute[71330]:     <apic/>
Apr 14 12:01:27 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:01:27 user nova-compute[71330]:   </features>
Apr 14 12:01:27 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:01:27 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:01:27 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:01:27 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:01:27 user nova-compute[71330]:   </clock>
Apr 14 12:01:27 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:01:27 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:01:27 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:01:27 user nova-compute[71330]:   </cpu>
Apr 14 12:01:27 user nova-compute[71330]:   <devices>
Apr 14 12:01:27 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:01:27 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:01:27 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk"/>
Apr 14 12:01:27 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:01:27 user nova-compute[71330]:     </disk>
Apr 14 12:01:27 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:01:27 user nova-compute[71330]:       <mac address="fa:16:3e:e5:db:94"/>
Apr 14 12:01:27 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:27 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:01:27 user nova-compute[71330]:       <target dev="tapd7cd0790-d7"/>
Apr 14 12:01:27 user nova-compute[71330]:     </interface>
Apr 14 12:01:27 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:01:27 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/console.log" append="off"/>
Apr 14 12:01:27 user nova-compute[71330]:     </serial>
Apr 14 12:01:27 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:01:27 user nova-compute[71330]:     <video>
Apr 14 12:01:27 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:27 user nova-compute[71330]:     </video>
Apr 14 12:01:27 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:01:27 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:01:27 user nova-compute[71330]:     </rng>
Apr 14 12:01:27 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:01:27 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:01:27 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:01:27 user nova-compute[71330]:     </memballoon>
Apr 14 12:01:27 user nova-compute[71330]:   </devices>
Apr 14 12:01:27 user nova-compute[71330]: </domain>
Apr 14 12:01:27 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-523755696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG os_vif [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7cd0790-d7, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7cd0790-d7, col_values=(('external_ids', {'iface-id': 'd7cd0790-d778-4855-b7ad-c0b5c0258c1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:db:94', 'vm-uuid': '11e4aa91-7c03-46cc-8610-78f18bbd089f'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:01:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:27 user nova-compute[71330]: INFO os_vif [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7')
Apr 14 12:01:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No VIF found with MAC fa:16:3e:e5:db:94, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:01:28 user nova-compute[71330]: DEBUG nova.network.neutron [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updated VIF entry in instance network info cache for port d7cd0790-d778-4855-b7ad-c0b5c0258c1b. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:01:28 user nova-compute[71330]: DEBUG nova.network.neutron [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:01:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] Releasing lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:01:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:29 user nova-compute[71330]: WARNING nova.compute.manager [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state building and task_state spawning.
Apr 14 12:01:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:31 user nova-compute[71330]: WARNING nova.compute.manager [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state building and task_state spawning.
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473692.0150137, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Resumed (Lifecycle Event)
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:01:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance spawned successfully.
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473692.0204823, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Started (Lifecycle Event)
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:32 user nova-compute[71330]: INFO nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Took 6.44 seconds to spawn the instance on the hypervisor.
Apr 14 12:01:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:01:32 user nova-compute[71330]: INFO nova.compute.manager [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Took 7.27 seconds to build instance.
Apr 14 12:01:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.377s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:01:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:01:35 user nova-compute[71330]: INFO nova.compute.claims [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Claim successful on node user
Apr 14 12:01:36 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:01:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:01:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:01:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Creating image(s)
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "/opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "/opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG nova.policy [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '288a3cdba40944e0b3bb945ba21d2f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a871a3dc4a5a81f6bac70701177b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.150s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk 1073741824" returned: 0 in 0.062s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:36 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Cannot resize image /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG nova.objects.instance [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lazy-loading 'migration_context' on Instance uuid b1b9021d-2463-4267-8cb7-cc1c47d54f77 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Ensure instance console log exists: /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Successfully created port: ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:01:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Successfully updated port: ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "refresh_cache-b1b9021d-2463-4267-8cb7-cc1c47d54f77" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquired lock "refresh_cache-b1b9021d-2463-4267-8cb7-cc1c47d54f77" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received event network-changed-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Refreshing instance network info cache due to event network-changed-ced10da8-d1f9-48ae-9e76-68c3008018f1. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] Acquiring lock "refresh_cache-b1b9021d-2463-4267-8cb7-cc1c47d54f77" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Updating instance_info_cache with network_info: [{"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Releasing lock "refresh_cache-b1b9021d-2463-4267-8cb7-cc1c47d54f77" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Instance network_info: |[{"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] Acquired lock "refresh_cache-b1b9021d-2463-4267-8cb7-cc1c47d54f77" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.network.neutron [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Refreshing network info cache for port ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Start _get_guest_xml network_info=[{"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:01:38 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:38 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1585756320',display_name='tempest-VolumesNegativeTest-instance-1585756320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1585756320',id=16,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc91a871a3dc4a5a81f6bac70701177b',ramdisk_id='',reservation_id='r-49gj1wcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-992240870',owner_user_name='tempest-VolumesNegativeTest-992240870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:01:36Z,user_data=None,user_id='288a3cdba40944e0b3bb945ba21d2f1d',uuid=b1b9021d-2463-4267-8cb7-cc1c47d54f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Converting VIF {"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0d:a4,bridge_name='br-int',has_traffic_filtering=True,id=ced10da8-d1f9-48ae-9e76-68c3008018f1,network=Network(5f6652b6-7efd-4036-a12f-b4b0ddfec55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10da8-d1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.objects.instance [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lazy-loading 'pci_devices' on Instance uuid b1b9021d-2463-4267-8cb7-cc1c47d54f77 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:01:38 user nova-compute[71330]:   <uuid>b1b9021d-2463-4267-8cb7-cc1c47d54f77</uuid>
Apr 14 12:01:38 user nova-compute[71330]:   <name>instance-00000010</name>
Apr 14 12:01:38 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:01:38 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:01:38 user nova-compute[71330]:   <metadata>
Apr 14 12:01:38 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:01:38 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:01:38 user nova-compute[71330]:       <nova:name>tempest-VolumesNegativeTest-instance-1585756320</nova:name>
Apr 14 12:01:38 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:01:38</nova:creationTime>
Apr 14 12:01:38 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:01:38 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:01:38 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:01:38 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:01:38 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:01:38 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:01:38 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:01:38 user nova-compute[71330]:       <nova:owner>
Apr 14 12:01:38 user nova-compute[71330]:         <nova:user uuid="288a3cdba40944e0b3bb945ba21d2f1d">tempest-VolumesNegativeTest-992240870-project-member</nova:user>
Apr 14 12:01:38 user nova-compute[71330]:         <nova:project uuid="cc91a871a3dc4a5a81f6bac70701177b">tempest-VolumesNegativeTest-992240870</nova:project>
Apr 14 12:01:38 user nova-compute[71330]:       </nova:owner>
Apr 14 12:01:38 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:01:38 user nova-compute[71330]:       <nova:ports>
Apr 14 12:01:38 user nova-compute[71330]:         <nova:port uuid="ced10da8-d1f9-48ae-9e76-68c3008018f1">
Apr 14 12:01:38 user nova-compute[71330]:           <nova:ip type="fixed" address="192.168.233.9" ipVersion="4"/>
Apr 14 12:01:38 user nova-compute[71330]:         </nova:port>
Apr 14 12:01:38 user nova-compute[71330]:       </nova:ports>
Apr 14 12:01:38 user nova-compute[71330]:     </nova:instance>
Apr 14 12:01:38 user nova-compute[71330]:   </metadata>
Apr 14 12:01:38 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:01:38 user nova-compute[71330]:     <system>
Apr 14 12:01:38 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:01:38 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:01:38 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:01:38 user nova-compute[71330]:       <entry name="serial">b1b9021d-2463-4267-8cb7-cc1c47d54f77</entry>
Apr 14 12:01:38 user nova-compute[71330]:       <entry name="uuid">b1b9021d-2463-4267-8cb7-cc1c47d54f77</entry>
Apr 14 12:01:38 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:01:38 user nova-compute[71330]:     </system>
Apr 14 12:01:38 user nova-compute[71330]:   </sysinfo>
Apr 14 12:01:38 user nova-compute[71330]:   <os>
Apr 14 12:01:38 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:01:38 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:01:38 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:01:38 user nova-compute[71330]:   </os>
Apr 14 12:01:38 user nova-compute[71330]:   <features>
Apr 14 12:01:38 user nova-compute[71330]:     <acpi/>
Apr 14 12:01:38 user nova-compute[71330]:     <apic/>
Apr 14 12:01:38 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:01:38 user nova-compute[71330]:   </features>
Apr 14 12:01:38 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:01:38 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:01:38 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:01:38 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:01:38 user nova-compute[71330]:   </clock>
Apr 14 12:01:38 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:01:38 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:01:38 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:01:38 user nova-compute[71330]:   </cpu>
Apr 14 12:01:38 user nova-compute[71330]:   <devices>
Apr 14 12:01:38 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:01:38 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:01:38 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk"/>
Apr 14 12:01:38 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:01:38 user nova-compute[71330]:     </disk>
Apr 14 12:01:38 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:01:38 user nova-compute[71330]:       <mac address="fa:16:3e:2e:0d:a4"/>
Apr 14 12:01:38 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:38 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:01:38 user nova-compute[71330]:       <target dev="tapced10da8-d1"/>
Apr 14 12:01:38 user nova-compute[71330]:     </interface>
Apr 14 12:01:38 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:01:38 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/console.log" append="off"/>
Apr 14 12:01:38 user nova-compute[71330]:     </serial>
Apr 14 12:01:38 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:01:38 user nova-compute[71330]:     <video>
Apr 14 12:01:38 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:38 user nova-compute[71330]:     </video>
Apr 14 12:01:38 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:01:38 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:01:38 user nova-compute[71330]:     </rng>
Apr 14 12:01:38 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:01:38 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:01:38 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:01:38 user nova-compute[71330]:     </memballoon>
Apr 14 12:01:38 user nova-compute[71330]:   </devices>
Apr 14 12:01:38 user nova-compute[71330]: </domain>
Apr 14 12:01:38 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1585756320',display_name='tempest-VolumesNegativeTest-instance-1585756320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1585756320',id=16,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc91a871a3dc4a5a81f6bac70701177b',ramdisk_id='',reservation_id='r-49gj1wcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-992240870',owner_user_name='tempest-VolumesNegativeTest-992240870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:01:36Z,user_data=None,user_id='288a3cdba40944e0b3bb945ba21d2f1d',uuid=b1b9021d-2463-4267-8cb7-cc1c47d54f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Converting VIF {"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0d:a4,bridge_name='br-int',has_traffic_filtering=True,id=ced10da8-d1f9-48ae-9e76-68c3008018f1,network=Network(5f6652b6-7efd-4036-a12f-b4b0ddfec55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10da8-d1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG os_vif [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0d:a4,bridge_name='br-int',has_traffic_filtering=True,id=ced10da8-d1f9-48ae-9e76-68c3008018f1,network=Network(5f6652b6-7efd-4036-a12f-b4b0ddfec55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10da8-d1') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapced10da8-d1, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapced10da8-d1, col_values=(('external_ids', {'iface-id': 'ced10da8-d1f9-48ae-9e76-68c3008018f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:0d:a4', 'vm-uuid': 'b1b9021d-2463-4267-8cb7-cc1c47d54f77'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:38 user nova-compute[71330]: INFO os_vif [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0d:a4,bridge_name='br-int',has_traffic_filtering=True,id=ced10da8-d1f9-48ae-9e76-68c3008018f1,network=Network(5f6652b6-7efd-4036-a12f-b4b0ddfec55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10da8-d1')
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] No VIF found with MAC fa:16:3e:2e:0d:a4, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:01:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:39 user nova-compute[71330]: DEBUG nova.network.neutron [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Updated VIF entry in instance network info cache for port ced10da8-d1f9-48ae-9e76-68c3008018f1. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:01:39 user nova-compute[71330]: DEBUG nova.network.neutron [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Updating instance_info_cache with network_info: [{"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:01:39 user nova-compute[71330]: INFO nova.compute.manager [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Rescuing
Apr 14 12:01:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:01:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquired lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:01:39 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:01:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] Releasing lock "refresh_cache-b1b9021d-2463-4267-8cb7-cc1c47d54f77" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:01:39 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updating instance_info_cache with network_info: [{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:01:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Releasing lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-unplugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-unplugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:40 user nova-compute[71330]: WARNING nova.compute.manager [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-unplugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state active and task_state rescuing.
Apr 14 12:01:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received event network-vif-plugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] Acquiring lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] No waiting events found dispatching network-vif-plugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:40 user nova-compute[71330]: WARNING nova.compute.manager [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received unexpected event network-vif-plugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance with vm_state building and task_state spawning.
Apr 14 12:01:41 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Instance destroyed successfully.
Apr 14 12:01:41 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Attempting rescue
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71330) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Instance directory exists: not creating {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 12:01:41 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Creating image(s)
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue" returned: 0 in 0.057s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'migration_context' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Start _get_guest_xml network_info=[{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "vif_mac": "fa:16:3e:66:f5:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'resources' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'numa_topology' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:41 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:41 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621276567',display_name='tempest-ServerRescueNegativeTestJSON-server-1621276567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621276567',id=1,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-x60bo87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:57:17Z,user_data=None,user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=16a25a1d-bc8b-4de0-b975-037aee0d46ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "vif_mac": "fa:16:3e:66:f5:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "vif_mac": "fa:16:3e:66:f5:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:f5:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6abe9bd-ec11-4204-9e3d-79e395495588,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6abe9bd-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'pci_devices' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:01:41 user nova-compute[71330]:   <uuid>16a25a1d-bc8b-4de0-b975-037aee0d46ee</uuid>
Apr 14 12:01:41 user nova-compute[71330]:   <name>instance-00000001</name>
Apr 14 12:01:41 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:01:41 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:01:41 user nova-compute[71330]:   <metadata>
Apr 14 12:01:41 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:01:41 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:01:41 user nova-compute[71330]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1621276567</nova:name>
Apr 14 12:01:41 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:01:41</nova:creationTime>
Apr 14 12:01:41 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:01:41 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:01:41 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:01:41 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:01:41 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:01:41 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:01:41 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:01:41 user nova-compute[71330]:       <nova:owner>
Apr 14 12:01:41 user nova-compute[71330]:         <nova:user uuid="263c47076ee94cfaaa34eff928a36fdd">tempest-ServerRescueNegativeTestJSON-896417797-project-member</nova:user>
Apr 14 12:01:41 user nova-compute[71330]:         <nova:project uuid="f042abdcef8f41488e8f4624c2f4970b">tempest-ServerRescueNegativeTestJSON-896417797</nova:project>
Apr 14 12:01:41 user nova-compute[71330]:       </nova:owner>
Apr 14 12:01:41 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:01:41 user nova-compute[71330]:       <nova:ports>
Apr 14 12:01:41 user nova-compute[71330]:         <nova:port uuid="e6abe9bd-ec11-4204-9e3d-79e395495588">
Apr 14 12:01:41 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 12:01:41 user nova-compute[71330]:         </nova:port>
Apr 14 12:01:41 user nova-compute[71330]:       </nova:ports>
Apr 14 12:01:41 user nova-compute[71330]:     </nova:instance>
Apr 14 12:01:41 user nova-compute[71330]:   </metadata>
Apr 14 12:01:41 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:01:41 user nova-compute[71330]:     <system>
Apr 14 12:01:41 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:01:41 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:01:41 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:01:41 user nova-compute[71330]:       <entry name="serial">16a25a1d-bc8b-4de0-b975-037aee0d46ee</entry>
Apr 14 12:01:41 user nova-compute[71330]:       <entry name="uuid">16a25a1d-bc8b-4de0-b975-037aee0d46ee</entry>
Apr 14 12:01:41 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:01:41 user nova-compute[71330]:     </system>
Apr 14 12:01:41 user nova-compute[71330]:   </sysinfo>
Apr 14 12:01:41 user nova-compute[71330]:   <os>
Apr 14 12:01:41 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:01:41 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:01:41 user nova-compute[71330]:   </os>
Apr 14 12:01:41 user nova-compute[71330]:   <features>
Apr 14 12:01:41 user nova-compute[71330]:     <acpi/>
Apr 14 12:01:41 user nova-compute[71330]:     <apic/>
Apr 14 12:01:41 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:01:41 user nova-compute[71330]:   </features>
Apr 14 12:01:41 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:01:41 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:01:41 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:01:41 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:01:41 user nova-compute[71330]:   </clock>
Apr 14 12:01:41 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:01:41 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:01:41 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:01:41 user nova-compute[71330]:   </cpu>
Apr 14 12:01:41 user nova-compute[71330]:   <devices>
Apr 14 12:01:41 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:01:41 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:01:41 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue"/>
Apr 14 12:01:41 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:01:41 user nova-compute[71330]:     </disk>
Apr 14 12:01:41 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:01:41 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:01:41 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk"/>
Apr 14 12:01:41 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:01:41 user nova-compute[71330]:     </disk>
Apr 14 12:01:41 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:01:41 user nova-compute[71330]:       <mac address="fa:16:3e:66:f5:bb"/>
Apr 14 12:01:41 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:41 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:01:41 user nova-compute[71330]:       <target dev="tape6abe9bd-ec"/>
Apr 14 12:01:41 user nova-compute[71330]:     </interface>
Apr 14 12:01:41 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:01:41 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/console.log" append="off"/>
Apr 14 12:01:41 user nova-compute[71330]:     </serial>
Apr 14 12:01:41 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:01:41 user nova-compute[71330]:     <video>
Apr 14 12:01:41 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:01:41 user nova-compute[71330]:     </video>
Apr 14 12:01:41 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:01:41 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:01:41 user nova-compute[71330]:     </rng>
Apr 14 12:01:41 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:01:41 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:01:41 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:01:41 user nova-compute[71330]:     </memballoon>
Apr 14 12:01:41 user nova-compute[71330]:   </devices>
Apr 14 12:01:41 user nova-compute[71330]: </domain>
Apr 14 12:01:41 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:01:41 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Instance destroyed successfully.
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:01:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No VIF found with MAC fa:16:3e:66:f5:bb, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:01:42 user nova-compute[71330]: DEBUG nova.compute.manager [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:42 user nova-compute[71330]: DEBUG nova.compute.manager [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:42 user nova-compute[71330]: WARNING nova.compute.manager [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state active and task_state rescuing.
Apr 14 12:01:42 user nova-compute[71330]: DEBUG nova.compute.manager [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received event network-vif-plugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] Acquiring lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:42 user nova-compute[71330]: DEBUG nova.compute.manager [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] No waiting events found dispatching network-vif-plugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:42 user nova-compute[71330]: WARNING nova.compute.manager [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received unexpected event network-vif-plugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance with vm_state building and task_state spawning.
Apr 14 12:01:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473703.1400065, b1b9021d-2463-4267-8cb7-cc1c47d54f77 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:43 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] VM Resumed (Lifecycle Event)
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:43 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Instance spawned successfully.
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:43 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473703.1435556, b1b9021d-2463-4267-8cb7-cc1c47d54f77 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:43 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] VM Started (Lifecycle Event)
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:43 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:01:43 user nova-compute[71330]: INFO nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Took 6.92 seconds to spawn the instance on the hypervisor.
Apr 14 12:01:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:43 user nova-compute[71330]: INFO nova.compute.manager [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Took 7.85 seconds to build instance.
Apr 14 12:01:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.965s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:44 user nova-compute[71330]: WARNING nova.compute.manager [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state active and task_state rescuing.
Apr 14 12:01:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:01:44 user nova-compute[71330]: WARNING nova.compute.manager [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state active and task_state rescuing.
Apr 14 12:01:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 16a25a1d-bc8b-4de0-b975-037aee0d46ee due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:01:45 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473705.5519178, 16a25a1d-bc8b-4de0-b975-037aee0d46ee => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:45 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] VM Resumed (Lifecycle Event)
Apr 14 12:01:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:45 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 12:01:45 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473705.5526211, 16a25a1d-bc8b-4de0-b975-037aee0d46ee => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:01:45 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] VM Started (Lifecycle Event)
Apr 14 12:01:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:01:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:01:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:01:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:01:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updating instance_info_cache with network_info: [{"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:51 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing instance network info cache due to event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] Acquiring lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] Acquired lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG nova.network.neutron [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:01:57 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:57 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7579MB free_disk=26.321014404296875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 25eda1c2-9b82-412f-b75d-358e87847a29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing instance network info cache due to event network-changed-1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] Acquiring lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.network.neutron [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updated VIF entry in instance network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.network.neutron [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating instance_info_cache with network_info: [{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] Releasing lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] Acquired lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.network.neutron [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Refreshing network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:01:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:01:57 user nova-compute[71330]: INFO nova.compute.manager [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Detaching volume 02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 12:01:58 user nova-compute[71330]: INFO nova.virt.block_device [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Attempting to driver detach volume 02f6321c-fa2b-4e36-8b89-caffe1df4027 from mountpoint /dev/vdb
Apr 14 12:01:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Attempting to detach device vdb from instance 25eda1c2-9b82-412f-b75d-358e87847a29 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:01:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:01:58 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:01:58 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:01:58 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:01:58 user nova-compute[71330]:   <serial>02f6321c-fa2b-4e36-8b89-caffe1df4027</serial>
Apr 14 12:01:58 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 12:01:58 user nova-compute[71330]: </disk>
Apr 14 12:01:58 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:01:58 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully detached device vdb from instance 25eda1c2-9b82-412f-b75d-358e87847a29 from the persistent domain config.
Apr 14 12:01:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25eda1c2-9b82-412f-b75d-358e87847a29 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:01:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:01:58 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:01:58 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:01:58 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:01:58 user nova-compute[71330]:   <serial>02f6321c-fa2b-4e36-8b89-caffe1df4027</serial>
Apr 14 12:01:58 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 12:01:58 user nova-compute[71330]: </disk>
Apr 14 12:01:58 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:01:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updated VIF entry in instance network info cache for port 1aad7982-a338-4425-9e53-ea99f31b0de6. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:01:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating instance_info_cache with network_info: [{"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:01:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] Releasing lock "refresh_cache-25eda1c2-9b82-412f-b75d-358e87847a29" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:01:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473719.031908, 25eda1c2-9b82-412f-b75d-358e87847a29 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:01:59 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully detached device vdb from instance 25eda1c2-9b82-412f-b75d-358e87847a29 from the live domain config.
Apr 14 12:01:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJWXHFac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:01:59 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca97e9b2-d046-4697-b012-72231da33e49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:01:59 user nova-compute[71330]: No targets found.
Apr 14 12:01:59 user nova-compute[71330]: iSNS:
Apr 14 12:01:59 user nova-compute[71330]: No targets found.
Apr 14 12:01:59 user nova-compute[71330]: STATIC:
Apr 14 12:01:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669
Apr 14 12:01:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:01:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:01:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:01:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:01:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:01:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff
Apr 14 12:01:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:01:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:01:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027
Apr 14 12:01:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:01:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:01:59 user nova-compute[71330]: FIRMWARE:
Apr 14 12:01:59 user nova-compute[71330]: No targets found.
Apr 14 12:01:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:01:59 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:01:59 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[df538dca-858d-49ab-8d2b-94806f8571c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[41731ae3-c362-4fa1-8f34-7ab4b71a517b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:59 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:59 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:59 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:01:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 (non-flash)
Apr 14 12:01:59 user nova-compute[71330]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:01:59 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:01:59 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:01:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962b54c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a524bea-f13e-4a95-ae25-566702ef39ff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa061ff-c730-4635-9760-2bc47df23ef9]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[465f43c9-7eac-4c30-b134-fe8d5be8a5b4]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[235f6554-62c0-4098-a316-7ae58bba5493]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b898583-32ef-4c27-a6dc-e3b70303fcd6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[933f6d34-06b6-43af-b060-9e1cd9cf4678]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260]
Apr 14 12:01:59 user nova-compute[71330]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027, portal: 172.16.0.220,3260] successful.
Apr 14 12:01:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f6321c-fa2b-4e36-8b89-caffe1df4027 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[22672dd4-30d5-4011-a8c2-61ee4b386421]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] <== disconnect_volume: return (371ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:01:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:02:00 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'flavor' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.459s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:14 user nova-compute[71330]: INFO nova.compute.manager [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Terminating instance
Apr 14 12:02:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received event network-vif-unplugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] Acquiring lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] No waiting events found dispatching network-vif-unplugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received event network-vif-unplugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:02:15 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Instance destroyed successfully.
Apr 14 12:02:15 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'resources' on Instance uuid 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1095164094',display_name='tempest-VolumesAdminNegativeTest-server-1095164094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1095164094',id=13,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1dde7a2b6d498cbb829c51bfafadee',ramdisk_id='',reservation_id='r-5jo2ynto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1955614665',owner_user_name='tempest-VolumesAdminNegativeTest-1955614665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:00:24Z,user_data=None,user_id='390ba60eb6f3478fb8225976ee516218',uuid=33c5eb35-5061-43d1-8c9b-fb88b7bc8c84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converting VIF {"id": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "address": "fa:16:3e:4c:3f:9e", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccd217a-df", "ovs_interfaceid": "dccd217a-dfee-484e-a4cd-2d94ba4326ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3f:9e,bridge_name='br-int',has_traffic_filtering=True,id=dccd217a-dfee-484e-a4cd-2d94ba4326ab,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccd217a-df') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG os_vif [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3f:9e,bridge_name='br-int',has_traffic_filtering=True,id=dccd217a-dfee-484e-a4cd-2d94ba4326ab,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccd217a-df') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdccd217a-df, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:15 user nova-compute[71330]: INFO os_vif [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3f:9e,bridge_name='br-int',has_traffic_filtering=True,id=dccd217a-dfee-484e-a4cd-2d94ba4326ab,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccd217a-df')
Apr 14 12:02:15 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Deleting instance files /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84_del
Apr 14 12:02:15 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Deletion of /opt/stack/data/nova/instances/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84_del complete
Apr 14 12:02:15 user nova-compute[71330]: INFO nova.compute.manager [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 14 12:02:15 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:15 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Took 0.65 seconds to deallocate network for instance.
Apr 14 12:02:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-714aaeaf-783b-4ce1-8818-33f458bf59b8 req-ff067637-e017-4757-8613-59338d8e55f1 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received event network-vif-deleted-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:16 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:02:16 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:02:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:16 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Deleted allocations for instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84
Apr 14 12:02:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.214s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received event network-vif-plugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] Acquiring lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] Lock "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] No waiting events found dispatching network-vif-plugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:16 user nova-compute[71330]: WARNING nova.compute.manager [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Received unexpected event network-vif-plugged-dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance with vm_state deleted and task_state None.
Apr 14 12:02:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:02:18 user nova-compute[71330]: INFO nova.compute.claims [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Claim successful on node user
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.network.neutron [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:02:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.policy [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:02:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Creating image(s)
Apr 14 12:02:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "/opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "/opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk 1073741824" returned: 0 in 0.055s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Cannot resize image /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG nova.objects.instance [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'migration_context' on Instance uuid ba2689ad-6a47-45c2-b5db-bec9e5a152ac {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG nova.network.neutron [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Successfully created port: fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Ensure instance console log exists: /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.network.neutron [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Successfully updated port: fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquired lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.network.neutron [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-changed-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Refreshing instance network info cache due to event network-changed-fd5df68e-d97d-41be-a98a-d5d7b77a0044. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] Acquiring lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.network.neutron [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.network.neutron [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updating instance_info_cache with network_info: [{"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Releasing lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Instance network_info: |[{"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] Acquired lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Refreshing network info cache for port fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Start _get_guest_xml network_info=[{"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:02:20 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:02:20 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1734254147',display_name='tempest-TestStampPattern-server-1734254147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1734254147',id=17,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcWumXfNSjLDovtKNaUkPPvNJyQGmlmWEq5lmR1ljchHoI3F3BUNa7dKibvc69DYc5cYCD1AWmxfaa3wcxsCbua+WlZRoR5F/ExK2Ac04hcBu8nxWqQ13C+9/nYhnqwIg==',key_name='tempest-TestStampPattern-1794429979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfb2ac7942e1473f88b05de5aa79a3ee',ramdisk_id='',reservation_id='r-9ze94gji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1032317746',owner_user_name='tempest-TestStampPattern-1032317746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:02:19Z,user_data=None,user_id='e2b8b516910f41ffbb8bbf5f9e3c2ec8',uuid=ba2689ad-6a47-45c2-b5db-bec9e5a152ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converting VIF {"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:52:4c,bridge_name='br-int',has_traffic_filtering=True,id=fd5df68e-d97d-41be-a98a-d5d7b77a0044,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5df68e-d9') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'pci_devices' on Instance uuid ba2689ad-6a47-45c2-b5db-bec9e5a152ac {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:02:20 user nova-compute[71330]:   <uuid>ba2689ad-6a47-45c2-b5db-bec9e5a152ac</uuid>
Apr 14 12:02:20 user nova-compute[71330]:   <name>instance-00000011</name>
Apr 14 12:02:20 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:02:20 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:02:20 user nova-compute[71330]:   <metadata>
Apr 14 12:02:20 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:02:20 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:02:20 user nova-compute[71330]:       <nova:name>tempest-TestStampPattern-server-1734254147</nova:name>
Apr 14 12:02:20 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:02:20</nova:creationTime>
Apr 14 12:02:20 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:02:20 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:02:20 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:02:20 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:02:20 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:02:20 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:02:20 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:02:20 user nova-compute[71330]:       <nova:owner>
Apr 14 12:02:20 user nova-compute[71330]:         <nova:user uuid="e2b8b516910f41ffbb8bbf5f9e3c2ec8">tempest-TestStampPattern-1032317746-project-member</nova:user>
Apr 14 12:02:20 user nova-compute[71330]:         <nova:project uuid="cfb2ac7942e1473f88b05de5aa79a3ee">tempest-TestStampPattern-1032317746</nova:project>
Apr 14 12:02:20 user nova-compute[71330]:       </nova:owner>
Apr 14 12:02:20 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:02:20 user nova-compute[71330]:       <nova:ports>
Apr 14 12:02:20 user nova-compute[71330]:         <nova:port uuid="fd5df68e-d97d-41be-a98a-d5d7b77a0044">
Apr 14 12:02:20 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 12:02:20 user nova-compute[71330]:         </nova:port>
Apr 14 12:02:20 user nova-compute[71330]:       </nova:ports>
Apr 14 12:02:20 user nova-compute[71330]:     </nova:instance>
Apr 14 12:02:20 user nova-compute[71330]:   </metadata>
Apr 14 12:02:20 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:02:20 user nova-compute[71330]:     <system>
Apr 14 12:02:20 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:02:20 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:02:20 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:02:20 user nova-compute[71330]:       <entry name="serial">ba2689ad-6a47-45c2-b5db-bec9e5a152ac</entry>
Apr 14 12:02:20 user nova-compute[71330]:       <entry name="uuid">ba2689ad-6a47-45c2-b5db-bec9e5a152ac</entry>
Apr 14 12:02:20 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:02:20 user nova-compute[71330]:     </system>
Apr 14 12:02:20 user nova-compute[71330]:   </sysinfo>
Apr 14 12:02:20 user nova-compute[71330]:   <os>
Apr 14 12:02:20 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:02:20 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:02:20 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:02:20 user nova-compute[71330]:   </os>
Apr 14 12:02:20 user nova-compute[71330]:   <features>
Apr 14 12:02:20 user nova-compute[71330]:     <acpi/>
Apr 14 12:02:20 user nova-compute[71330]:     <apic/>
Apr 14 12:02:20 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:02:20 user nova-compute[71330]:   </features>
Apr 14 12:02:20 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:02:20 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:02:20 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:02:20 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:02:20 user nova-compute[71330]:   </clock>
Apr 14 12:02:20 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:02:20 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:02:20 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:02:20 user nova-compute[71330]:   </cpu>
Apr 14 12:02:20 user nova-compute[71330]:   <devices>
Apr 14 12:02:20 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:02:20 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:02:20 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk"/>
Apr 14 12:02:20 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:02:20 user nova-compute[71330]:     </disk>
Apr 14 12:02:20 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:02:20 user nova-compute[71330]:       <mac address="fa:16:3e:88:52:4c"/>
Apr 14 12:02:20 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:02:20 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:02:20 user nova-compute[71330]:       <target dev="tapfd5df68e-d9"/>
Apr 14 12:02:20 user nova-compute[71330]:     </interface>
Apr 14 12:02:20 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:02:20 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/console.log" append="off"/>
Apr 14 12:02:20 user nova-compute[71330]:     </serial>
Apr 14 12:02:20 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:02:20 user nova-compute[71330]:     <video>
Apr 14 12:02:20 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:02:20 user nova-compute[71330]:     </video>
Apr 14 12:02:20 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:02:20 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:02:20 user nova-compute[71330]:     </rng>
Apr 14 12:02:20 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:02:20 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:02:20 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:02:20 user nova-compute[71330]:     </memballoon>
Apr 14 12:02:20 user nova-compute[71330]:   </devices>
Apr 14 12:02:20 user nova-compute[71330]: </domain>
Apr 14 12:02:20 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1734254147',display_name='tempest-TestStampPattern-server-1734254147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1734254147',id=17,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcWumXfNSjLDovtKNaUkPPvNJyQGmlmWEq5lmR1ljchHoI3F3BUNa7dKibvc69DYc5cYCD1AWmxfaa3wcxsCbua+WlZRoR5F/ExK2Ac04hcBu8nxWqQ13C+9/nYhnqwIg==',key_name='tempest-TestStampPattern-1794429979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfb2ac7942e1473f88b05de5aa79a3ee',ramdisk_id='',reservation_id='r-9ze94gji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1032317746',owner_user_name='tempest-TestStampPattern-1032317746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:02:19Z,user_data=None,user_id='e2b8b516910f41ffbb8bbf5f9e3c2ec8',uuid=ba2689ad-6a47-45c2-b5db-bec9e5a152ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converting VIF {"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:52:4c,bridge_name='br-int',has_traffic_filtering=True,id=fd5df68e-d97d-41be-a98a-d5d7b77a0044,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5df68e-d9') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG os_vif [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:52:4c,bridge_name='br-int',has_traffic_filtering=True,id=fd5df68e-d97d-41be-a98a-d5d7b77a0044,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5df68e-d9') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd5df68e-d9, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd5df68e-d9, col_values=(('external_ids', {'iface-id': 'fd5df68e-d97d-41be-a98a-d5d7b77a0044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:52:4c', 'vm-uuid': 'ba2689ad-6a47-45c2-b5db-bec9e5a152ac'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:20 user nova-compute[71330]: INFO os_vif [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:52:4c,bridge_name='br-int',has_traffic_filtering=True,id=fd5df68e-d97d-41be-a98a-d5d7b77a0044,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5df68e-d9')
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:02:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No VIF found with MAC fa:16:3e:88:52:4c, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:02:21 user nova-compute[71330]: DEBUG nova.network.neutron [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updated VIF entry in instance network info cache for port fd5df68e-d97d-41be-a98a-d5d7b77a0044. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:02:21 user nova-compute[71330]: DEBUG nova.network.neutron [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updating instance_info_cache with network_info: [{"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] Releasing lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG nova.compute.manager [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG nova.compute.manager [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] No waiting events found dispatching network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:22 user nova-compute[71330]: WARNING nova.compute.manager [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received unexpected event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance with vm_state building and task_state spawning.
Apr 14 12:02:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473744.3840601, ba2689ad-6a47-45c2-b5db-bec9e5a152ac => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:02:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] VM Resumed (Lifecycle Event)
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:02:24 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Instance spawned successfully.
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473744.387841, ba2689ad-6a47-45c2-b5db-bec9e5a152ac => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:02:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] VM Started (Lifecycle Event)
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:02:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:02:24 user nova-compute[71330]: INFO nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Took 5.60 seconds to spawn the instance on the hypervisor.
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:24 user nova-compute[71330]: INFO nova.compute.manager [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Took 6.46 seconds to build instance.
Apr 14 12:02:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.576s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] No waiting events found dispatching network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:24 user nova-compute[71330]: WARNING nova.compute.manager [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received unexpected event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance with vm_state active and task_state None.
Apr 14 12:02:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:30 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473735.0746899, 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:02:30 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] VM Stopped (Lifecycle Event)
Apr 14 12:02:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8124dc38-ea8b-4249-8801-a3d224f8e266 None None] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:02:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:30 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:02:30 user nova-compute[71330]: INFO nova.compute.claims [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Claim successful on node user
Apr 14 12:02:31 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:02:31 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:02:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:02:31 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Creating image(s)
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "/opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "/opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "/opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG nova.policy [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61adadbd79ef493889ef3dcb63f63fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5ac6388692423b9bf23bf6be0cb06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.166s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.129s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk 1073741824" returned: 0 in 0.056s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Cannot resize image /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'migration_context' on Instance uuid 93d16198-833e-4412-99ee-637bcf13624d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Ensure instance console log exists: /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Successfully created port: f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Successfully updated port: f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "refresh_cache-93d16198-833e-4412-99ee-637bcf13624d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquired lock "refresh_cache-93d16198-833e-4412-99ee-637bcf13624d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received event network-changed-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Refreshing instance network info cache due to event network-changed-f31873b1-ecc8-435f-b33b-75410f24a124. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] Acquiring lock "refresh_cache-93d16198-833e-4412-99ee-637bcf13624d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Updating instance_info_cache with network_info: [{"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Releasing lock "refresh_cache-93d16198-833e-4412-99ee-637bcf13624d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Instance network_info: |[{"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] Acquired lock "refresh_cache-93d16198-833e-4412-99ee-637bcf13624d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Refreshing network info cache for port f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Start _get_guest_xml network_info=[{"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:02:33 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:02:33 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1278423122',display_name='tempest-VolumesSnapshotTestJSON-instance-1278423122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1278423122',id=18,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5ac6388692423b9bf23bf6be0cb06d',ramdisk_id='',reservation_id='r-t92ykmh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1634639087',owner_user_name='tempest-VolumesSnapshotTestJSON-1634639087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:02:32Z,user_data=None,user_id='61adadbd79ef493889ef3dcb63f63fd8',uuid=93d16198-833e-4412-99ee-637bcf13624d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converting VIF {"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:c3:1e,bridge_name='br-int',has_traffic_filtering=True,id=f31873b1-ecc8-435f-b33b-75410f24a124,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31873b1-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'pci_devices' on Instance uuid 93d16198-833e-4412-99ee-637bcf13624d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:02:33 user nova-compute[71330]:   <uuid>93d16198-833e-4412-99ee-637bcf13624d</uuid>
Apr 14 12:02:33 user nova-compute[71330]:   <name>instance-00000012</name>
Apr 14 12:02:33 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:02:33 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:02:33 user nova-compute[71330]:   <metadata>
Apr 14 12:02:33 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:02:33 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:02:33 user nova-compute[71330]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1278423122</nova:name>
Apr 14 12:02:33 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:02:33</nova:creationTime>
Apr 14 12:02:33 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:02:33 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:02:33 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:02:33 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:02:33 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:02:33 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:02:33 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:02:33 user nova-compute[71330]:       <nova:owner>
Apr 14 12:02:33 user nova-compute[71330]:         <nova:user uuid="61adadbd79ef493889ef3dcb63f63fd8">tempest-VolumesSnapshotTestJSON-1634639087-project-member</nova:user>
Apr 14 12:02:33 user nova-compute[71330]:         <nova:project uuid="ae5ac6388692423b9bf23bf6be0cb06d">tempest-VolumesSnapshotTestJSON-1634639087</nova:project>
Apr 14 12:02:33 user nova-compute[71330]:       </nova:owner>
Apr 14 12:02:33 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:02:33 user nova-compute[71330]:       <nova:ports>
Apr 14 12:02:33 user nova-compute[71330]:         <nova:port uuid="f31873b1-ecc8-435f-b33b-75410f24a124">
Apr 14 12:02:33 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 12:02:33 user nova-compute[71330]:         </nova:port>
Apr 14 12:02:33 user nova-compute[71330]:       </nova:ports>
Apr 14 12:02:33 user nova-compute[71330]:     </nova:instance>
Apr 14 12:02:33 user nova-compute[71330]:   </metadata>
Apr 14 12:02:33 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:02:33 user nova-compute[71330]:     <system>
Apr 14 12:02:33 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:02:33 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:02:33 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:02:33 user nova-compute[71330]:       <entry name="serial">93d16198-833e-4412-99ee-637bcf13624d</entry>
Apr 14 12:02:33 user nova-compute[71330]:       <entry name="uuid">93d16198-833e-4412-99ee-637bcf13624d</entry>
Apr 14 12:02:33 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:02:33 user nova-compute[71330]:     </system>
Apr 14 12:02:33 user nova-compute[71330]:   </sysinfo>
Apr 14 12:02:33 user nova-compute[71330]:   <os>
Apr 14 12:02:33 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:02:33 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:02:33 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:02:33 user nova-compute[71330]:   </os>
Apr 14 12:02:33 user nova-compute[71330]:   <features>
Apr 14 12:02:33 user nova-compute[71330]:     <acpi/>
Apr 14 12:02:33 user nova-compute[71330]:     <apic/>
Apr 14 12:02:33 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:02:33 user nova-compute[71330]:   </features>
Apr 14 12:02:33 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:02:33 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:02:33 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:02:33 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:02:33 user nova-compute[71330]:   </clock>
Apr 14 12:02:33 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:02:33 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:02:33 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:02:33 user nova-compute[71330]:   </cpu>
Apr 14 12:02:33 user nova-compute[71330]:   <devices>
Apr 14 12:02:33 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:02:33 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:02:33 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk"/>
Apr 14 12:02:33 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:02:33 user nova-compute[71330]:     </disk>
Apr 14 12:02:33 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:02:33 user nova-compute[71330]:       <mac address="fa:16:3e:35:c3:1e"/>
Apr 14 12:02:33 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:02:33 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:02:33 user nova-compute[71330]:       <target dev="tapf31873b1-ec"/>
Apr 14 12:02:33 user nova-compute[71330]:     </interface>
Apr 14 12:02:33 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:02:33 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/console.log" append="off"/>
Apr 14 12:02:33 user nova-compute[71330]:     </serial>
Apr 14 12:02:33 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:02:33 user nova-compute[71330]:     <video>
Apr 14 12:02:33 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:02:33 user nova-compute[71330]:     </video>
Apr 14 12:02:33 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:02:33 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:02:33 user nova-compute[71330]:     </rng>
Apr 14 12:02:33 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:02:33 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:02:33 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:02:33 user nova-compute[71330]:     </memballoon>
Apr 14 12:02:33 user nova-compute[71330]:   </devices>
Apr 14 12:02:33 user nova-compute[71330]: </domain>
Apr 14 12:02:33 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1278423122',display_name='tempest-VolumesSnapshotTestJSON-instance-1278423122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1278423122',id=18,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5ac6388692423b9bf23bf6be0cb06d',ramdisk_id='',reservation_id='r-t92ykmh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1634639087',owner_user_name='tempest-VolumesSnapshotTestJSON-1634639087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:02:32Z,user_data=None,user_id='61adadbd79ef493889ef3dcb63f63fd8',uuid=93d16198-833e-4412-99ee-637bcf13624d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converting VIF {"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:c3:1e,bridge_name='br-int',has_traffic_filtering=True,id=f31873b1-ecc8-435f-b33b-75410f24a124,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31873b1-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG os_vif [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:c3:1e,bridge_name='br-int',has_traffic_filtering=True,id=f31873b1-ecc8-435f-b33b-75410f24a124,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31873b1-ec') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf31873b1-ec, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf31873b1-ec, col_values=(('external_ids', {'iface-id': 'f31873b1-ecc8-435f-b33b-75410f24a124', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:c3:1e', 'vm-uuid': '93d16198-833e-4412-99ee-637bcf13624d'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:33 user nova-compute[71330]: INFO os_vif [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:c3:1e,bridge_name='br-int',has_traffic_filtering=True,id=f31873b1-ecc8-435f-b33b-75410f24a124,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31873b1-ec')
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:02:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No VIF found with MAC fa:16:3e:35:c3:1e, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:02:34 user nova-compute[71330]: DEBUG nova.network.neutron [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Updated VIF entry in instance network info cache for port f31873b1-ecc8-435f-b33b-75410f24a124. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:02:34 user nova-compute[71330]: DEBUG nova.network.neutron [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Updating instance_info_cache with network_info: [{"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] Releasing lock "refresh_cache-93d16198-833e-4412-99ee-637bcf13624d" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:02:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received event network-vif-plugged-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] No waiting events found dispatching network-vif-plugged-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:35 user nova-compute[71330]: WARNING nova.compute.manager [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received unexpected event network-vif-plugged-f31873b1-ecc8-435f-b33b-75410f24a124 for instance with vm_state building and task_state spawning.
Apr 14 12:02:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 12:02:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] There are 0 instances to clean {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.compute.manager [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Detaching volume d60a2fbc-9189-4b30-96ac-16d35138d669
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.virt.block_device [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Attempting to driver detach volume d60a2fbc-9189-4b30-96ac-16d35138d669 from mountpoint /dev/vdc
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Attempting to detach device vdc from instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:02:37 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:02:37 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:02:37 user nova-compute[71330]:   <target dev="vdc" bus="virtio"/>
Apr 14 12:02:37 user nova-compute[71330]:   <serial>d60a2fbc-9189-4b30-96ac-16d35138d669</serial>
Apr 14 12:02:37 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 12:02:37 user nova-compute[71330]: </disk>
Apr 14 12:02:37 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully detached device vdc from instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 from the persistent domain config.
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:02:37 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:02:37 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:02:37 user nova-compute[71330]:   <target dev="vdc" bus="virtio"/>
Apr 14 12:02:37 user nova-compute[71330]:   <serial>d60a2fbc-9189-4b30-96ac-16d35138d669</serial>
Apr 14 12:02:37 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 12:02:37 user nova-compute[71330]: </disk>
Apr 14 12:02:37 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473757.7532897, 93d16198-833e-4412-99ee-637bcf13624d => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 93d16198-833e-4412-99ee-637bcf13624d] VM Resumed (Lifecycle Event)
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Instance spawned successfully.
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 93d16198-833e-4412-99ee-637bcf13624d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473757.7565866, 93d16198-833e-4412-99ee-637bcf13624d => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 93d16198-833e-4412-99ee-637bcf13624d] VM Started (Lifecycle Event)
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received event network-vif-plugged-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] No waiting events found dispatching network-vif-plugged-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:37 user nova-compute[71330]: WARNING nova.compute.manager [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received unexpected event network-vif-plugged-f31873b1-ecc8-435f-b33b-75410f24a124 for instance with vm_state building and task_state spawning.
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 93d16198-833e-4412-99ee-637bcf13624d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Took 6.22 seconds to spawn the instance on the hypervisor.
Apr 14 12:02:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:37 user nova-compute[71330]: INFO nova.compute.manager [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Took 7.02 seconds to build instance.
Apr 14 12:02:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.173s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473758.0143192, ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:02:38 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully detached device vdc from instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 from the live domain config.
Apr 14 12:02:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkZBiHbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:02:38 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[369e7653-c001-4daa-a6b6-b7611488eda7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:02:38 user nova-compute[71330]: No targets found.
Apr 14 12:02:38 user nova-compute[71330]: iSNS:
Apr 14 12:02:38 user nova-compute[71330]: No targets found.
Apr 14 12:02:38 user nova-compute[71330]: STATIC:
Apr 14 12:02:38 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669
Apr 14 12:02:38 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:02:38 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:02:38 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:02:38 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:02:38 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:02:38 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff
Apr 14 12:02:38 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:02:38 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:02:38 user nova-compute[71330]: FIRMWARE:
Apr 14 12:02:38 user nova-compute[71330]: No targets found.
Apr 14 12:02:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:02:38 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:02:38 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c53e2ee-b689-43f4-9a11-e9fa8c6c9828]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a9405-6e56-4144-b1d0-fc570ff64be1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:02:38 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:02:38 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:02:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:02:38 user nova-compute[71330]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 (non-flash)
Apr 14 12:02:38 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:02:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c2f1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669'): ({'sdd'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Removing single pathed devices sdd {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[67414c03-b52e-4b06-89b5-e5d8fea1971a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac7de93-fe56-4e14-8cc1-671fc6b6a6d2]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flushing IO for device /dev/sdd {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[be20a44a-d772-4c1f-a163-1b1af2c190c3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aacdfe-4151-4742-b202-906261cbf001]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[406b05be-58d6-4606-b599-b167f3249cd2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78ab90a-329e-4228-aad6-369337e4e203]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669, portal: 172.16.0.220,3260]
Apr 14 12:02:38 user nova-compute[71330]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669, portal: 172.16.0.220,3260] successful.
Apr 14 12:02:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60a2fbc-9189-4b30-96ac-16d35138d669 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d4f8b9-ab17-472b-834e-540e9bbc120b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] <== disconnect_volume: return (316ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:02:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG nova.objects.instance [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'flavor' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.728s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:02:39 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:40 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updating instance_info_cache with network_info: [{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:02:40 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:02:41 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:41 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:41 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:41 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:41 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:42 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:42 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:43 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:02:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:43 user nova-compute[71330]: INFO nova.compute.manager [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Rescuing
Apr 14 12:02:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:02:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquired lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:02:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updating instance_info_cache with network_info: [{"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Releasing lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-unplugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-unplugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:44 user nova-compute[71330]: WARNING nova.compute.manager [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-unplugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state active and task_state rescuing.
Apr 14 12:02:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Instance destroyed successfully.
Apr 14 12:02:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Attempting a stable device rescue
Apr 14 12:02:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71330) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 12:02:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Instance directory exists: not creating {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 12:02:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Creating image(s)
Apr 14 12:02:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "/opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "/opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:45 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'trusted_certs' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51.part --force-share --output=json" returned: 0 in 0.165s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG nova.virt.images [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 72232d56-9ae1-4d93-9ce8-68df7018a366 was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51.part /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51.part /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51.converted" returned: 0 in 0.196s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:46 user nova-compute[71330]: WARNING nova.compute.manager [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state active and task_state rescuing.
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.503s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51 --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51,backing_fmt=raw /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51,backing_fmt=raw /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue" returned: 0 in 0.048s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'migration_context' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Start _get_guest_xml network_info=[{"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "vif_mac": "fa:16:3e:75:f4:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '72232d56-9ae1-4d93-9ce8-68df7018a366', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'c9d2b452-ead8-43cc-a2dc-90475a9c686c', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHwghBUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'fcd74f51-099e-4c19-af7d-912f622fb153', 'attached_at': '', 'detached_at': '', 'volume_id': '46c09b71-b72b-49b5-89f7-d78ad27fd426', 'serial': '46c09b71-b72b-49b5-89f7-d78ad27fd426'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'resources' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'numa_topology' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:46 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:02:47 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'vcpu_model' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHwghBUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:02:47 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:02:47 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:02:47 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8d3a62-35c2-4b7b-a619-fefa727167bb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tHwghBUj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 12:02:47 user nova-compute[71330]: node.name = iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:02:47 user nova-compute[71330]: node.tpgt = -1
Apr 14 12:02:47 user nova-compute[71330]: node.startup = automatic
Apr 14 12:02:47 user nova-compute[71330]: node.leading_login = No
Apr 14 12:02:47 user nova-compute[71330]: iface.iscsi_ifacename = default
Apr 14 12:02:47 user nova-compute[71330]: iface.net_ifacename = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.ipaddress = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.prefix_len = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.hwaddress = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.transport_name = tcp
Apr 14 12:02:47 user nova-compute[71330]: iface.initiatorname = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.state = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.vlan_id = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.vlan_priority = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.vlan_state = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.iface_num = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.mtu = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.port = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.bootproto = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.subnet_mask = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.gateway = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.dhcp_alt_client_id = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.dhcp_dns = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.dhcp_learn_iqn = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.dhcp_vendor_id_state = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.dhcp_vendor_id = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.dhcp_slp_da = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.fragmentation = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.gratuitous_arp = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.incoming_forwarding = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.tos_state = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.tos = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.ttl = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.delayed_ack = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.tcp_nagle = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.tcp_wsf_state = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.tcp_wsf = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.tcp_timer_scale = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.tcp_timestamp = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.redirect = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.def_task_mgmt_timeout = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.header_digest = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.data_digest = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.immediate_data = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.initial_r2t = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.data_seq_inorder = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.data_pdu_inorder = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.erl = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.max_receive_data_len = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.first_burst_len = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.max_outstanding_r2t = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.max_burst_len = 0
Apr 14 12:02:47 user nova-compute[71330]: iface.chap_auth = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.bidi_chap = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.strict_login_compliance = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.discovery_auth = <empty>
Apr 14 12:02:47 user nova-compute[71330]: iface.discovery_logout = <empty>
Apr 14 12:02:47 user nova-compute[71330]: node.discovery_address = <empty>
Apr 14 12:02:47 user nova-compute[71330]: node.discovery_port = 0
Apr 14 12:02:47 user nova-compute[71330]: node.discovery_type = static
Apr 14 12:02:47 user nova-compute[71330]: node.session.initial_cmdsn = 0
Apr 14 12:02:47 user nova-compute[71330]: node.session.initial_login_retry_max = 8
Apr 14 12:02:47 user nova-compute[71330]: node.session.xmit_thread_priority = -20
Apr 14 12:02:47 user nova-compute[71330]: node.session.cmds_max = 128
Apr 14 12:02:47 user nova-compute[71330]: node.session.queue_depth = 32
Apr 14 12:02:47 user nova-compute[71330]: node.session.nr_sessions = 1
Apr 14 12:02:47 user nova-compute[71330]: node.session.auth.authmethod = CHAP
Apr 14 12:02:47 user nova-compute[71330]: node.session.auth.username = tHwghBUj
Apr 14 12:02:47 user nova-compute[71330]: node.session.auth.password = ***
Apr 14 12:02:47 user nova-compute[71330]: node.session.auth.username_in = <empty>
Apr 14 12:02:47 user nova-compute[71330]: node.session.auth.password_in = <empty>
Apr 14 12:02:47 user nova-compute[71330]: node.session.auth.chap_algs = MD5
Apr 14 12:02:47 user nova-compute[71330]: node.session.timeo.replacement_timeout = 120
Apr 14 12:02:47 user nova-compute[71330]: node.session.err_timeo.abort_timeout = 15
Apr 14 12:02:47 user nova-compute[71330]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 12:02:47 user nova-compute[71330]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 12:02:47 user nova-compute[71330]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.FastAbort = Yes
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.InitialR2T = No
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.ImmediateData = Yes
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.MaxConnections = 1
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 12:02:47 user nova-compute[71330]: node.session.iscsi.ERL = 0
Apr 14 12:02:47 user nova-compute[71330]: node.session.scan = manual
Apr 14 12:02:47 user nova-compute[71330]: node.session.reopen_max = 0
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].address = 172.16.0.220
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].port = 3260
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].startup = manual
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].tcp.window_size = 524288
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].tcp.type_of_service = 0
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].timeo.logout_timeout = 15
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].timeo.login_timeout = 15
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].timeo.auth_timeout = 45
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].iscsi.DataDigest = None
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].iscsi.IFMarker = No
Apr 14 12:02:47 user nova-compute[71330]: node.conn[0].iscsi.OFMarker = No
Apr 14 12:02:47 user nova-compute[71330]: # END RECORD
Apr 14 12:02:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e74dade-1576-48c0-b922-464d2ff2993c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f63fb2-e6ed-414c-b2b1-d25ddab15fec]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHwghBUj {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHwghBUj" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc800a3-e781-4097-aec8-d81b2fd21c03]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tHwghBUj'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b556c07a-cbe3-499d-b197-3c7f641b03bf]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[95293797-11f6-49df-8245-07f54f0ecf33]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:02:47 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:02:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:02:47 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:02:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] HCTL ('36', '0', '0', 0) found on session 18 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce89aad7-5c98-4943-a97e-3733f6670ee6]: (4, ('0 0 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Searching for a device in session 18 and hctl ('36', '0', '0', 0) yield: sde {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHwghBUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '26662343332323561', 'path': '/dev/sde'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662343332323561', 'path': '/dev/sde'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-378271548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-378271548',id=14,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-66dlqwhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:01:14Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=fcd74f51-099e-4c19-af7d-912f622fb153,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "vif_mac": "fa:16:3e:75:f4:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "vif_mac": "fa:16:3e:75:f4:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=a7084b3b-06c3-4e07-99fd-a37260b37f29,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7084b3b-06') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'pci_devices' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:02:47 user nova-compute[71330]:   <uuid>fcd74f51-099e-4c19-af7d-912f622fb153</uuid>
Apr 14 12:02:47 user nova-compute[71330]:   <name>instance-0000000e</name>
Apr 14 12:02:47 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:02:47 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:02:47 user nova-compute[71330]:   <metadata>
Apr 14 12:02:47 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:02:47 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:02:47 user nova-compute[71330]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-378271548</nova:name>
Apr 14 12:02:47 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:02:47</nova:creationTime>
Apr 14 12:02:47 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:02:47 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:02:47 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:02:47 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:02:47 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:02:47 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:02:47 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:02:47 user nova-compute[71330]:       <nova:owner>
Apr 14 12:02:47 user nova-compute[71330]:         <nova:user uuid="11df88c60e4b456691d8731fe8facf38">tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member</nova:user>
Apr 14 12:02:47 user nova-compute[71330]:         <nova:project uuid="2c5140d4419e43be941c2ac5d5439e35">tempest-ServerBootFromVolumeStableRescueTest-1565599676</nova:project>
Apr 14 12:02:47 user nova-compute[71330]:       </nova:owner>
Apr 14 12:02:47 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:02:47 user nova-compute[71330]:       <nova:ports>
Apr 14 12:02:47 user nova-compute[71330]:         <nova:port uuid="a7084b3b-06c3-4e07-99fd-a37260b37f29">
Apr 14 12:02:47 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 12:02:47 user nova-compute[71330]:         </nova:port>
Apr 14 12:02:47 user nova-compute[71330]:       </nova:ports>
Apr 14 12:02:47 user nova-compute[71330]:     </nova:instance>
Apr 14 12:02:47 user nova-compute[71330]:   </metadata>
Apr 14 12:02:47 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:02:47 user nova-compute[71330]:     <system>
Apr 14 12:02:47 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:02:47 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:02:47 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:02:47 user nova-compute[71330]:       <entry name="serial">fcd74f51-099e-4c19-af7d-912f622fb153</entry>
Apr 14 12:02:47 user nova-compute[71330]:       <entry name="uuid">fcd74f51-099e-4c19-af7d-912f622fb153</entry>
Apr 14 12:02:47 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:02:47 user nova-compute[71330]:     </system>
Apr 14 12:02:47 user nova-compute[71330]:   </sysinfo>
Apr 14 12:02:47 user nova-compute[71330]:   <os>
Apr 14 12:02:47 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:02:47 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:02:47 user nova-compute[71330]:   </os>
Apr 14 12:02:47 user nova-compute[71330]:   <features>
Apr 14 12:02:47 user nova-compute[71330]:     <acpi/>
Apr 14 12:02:47 user nova-compute[71330]:     <apic/>
Apr 14 12:02:47 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:02:47 user nova-compute[71330]:   </features>
Apr 14 12:02:47 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:02:47 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:02:47 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:02:47 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:02:47 user nova-compute[71330]:   </clock>
Apr 14 12:02:47 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:02:47 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:02:47 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:02:47 user nova-compute[71330]:   </cpu>
Apr 14 12:02:47 user nova-compute[71330]:   <devices>
Apr 14 12:02:47 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:02:47 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:02:47 user nova-compute[71330]:       <source dev="/dev/sde"/>
Apr 14 12:02:47 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:02:47 user nova-compute[71330]:       <serial>46c09b71-b72b-49b5-89f7-d78ad27fd426</serial>
Apr 14 12:02:47 user nova-compute[71330]:     </disk>
Apr 14 12:02:47 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:02:47 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:02:47 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue"/>
Apr 14 12:02:47 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:02:47 user nova-compute[71330]:       <boot order="1"/>
Apr 14 12:02:47 user nova-compute[71330]:     </disk>
Apr 14 12:02:47 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:02:47 user nova-compute[71330]:       <mac address="fa:16:3e:75:f4:77"/>
Apr 14 12:02:47 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:02:47 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:02:47 user nova-compute[71330]:       <target dev="tapa7084b3b-06"/>
Apr 14 12:02:47 user nova-compute[71330]:     </interface>
Apr 14 12:02:47 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:02:47 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/console.log" append="off"/>
Apr 14 12:02:47 user nova-compute[71330]:     </serial>
Apr 14 12:02:47 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:02:47 user nova-compute[71330]:     <video>
Apr 14 12:02:47 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:02:47 user nova-compute[71330]:     </video>
Apr 14 12:02:47 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:02:47 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:02:47 user nova-compute[71330]:     </rng>
Apr 14 12:02:47 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:02:47 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:02:47 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:02:47 user nova-compute[71330]:     </memballoon>
Apr 14 12:02:47 user nova-compute[71330]:   </devices>
Apr 14 12:02:47 user nova-compute[71330]: </domain>
Apr 14 12:02:47 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:02:47 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Instance destroyed successfully.
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No VIF found with MAC fa:16:3e:75:f4:77, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:47 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:48 user nova-compute[71330]: WARNING nova.compute.manager [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state active and task_state rescuing.
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for fcd74f51-099e-4c19-af7d-912f622fb153 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473770.7819428, fcd74f51-099e-4c19-af7d-912f622fb153 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:02:50 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] VM Resumed (Lifecycle Event)
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:50 user nova-compute[71330]: WARNING nova.compute.manager [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state active and task_state rescuing.
Apr 14 12:02:50 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473770.7872832, fcd74f51-099e-4c19-af7d-912f622fb153 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:02:50 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] VM Started (Lifecycle Event)
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:51 user nova-compute[71330]: INFO nova.compute.manager [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Terminating instance
Apr 14 12:02:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-unplugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] No waiting events found dispatching network-vif-unplugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-unplugged-1aad7982-a338-4425-9e53-ea99f31b0de6 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Instance destroyed successfully.
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'resources' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1398086214',display_name='tempest-TestMinimumBasicScenario-server-1398086214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1398086214',id=10,image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFIiKeQ/0Z0VfNZ6VUUlM9T5nZwFyI0LyXC8IRlH9W30muvQjtYrEeJ005baAqyTH/3Er2lAxmVvPn8aYg78pz/L256wjoD0MsMUEVdNJFcrEot77mjLycf8/vwxTsgA==',key_name='tempest-TestMinimumBasicScenario-565940781',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd9936aa363942f6a01bb64a8a8e74c9',ramdisk_id='',reservation_id='r-awo3v0q9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-881161311',owner_user_name='tempest-TestMinimumBasicScenario-881161311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:00:12Z,user_data=None,user_id='2eb32a03e7e04da18568294cca0e69bd',uuid=25eda1c2-9b82-412f-b75d-358e87847a29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converting VIF {"id": "1aad7982-a338-4425-9e53-ea99f31b0de6", "address": "fa:16:3e:4f:d4:34", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aad7982-a3", "ovs_interfaceid": "1aad7982-a338-4425-9e53-ea99f31b0de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG os_vif [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aad7982-a3, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:02:52 user nova-compute[71330]: INFO os_vif [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d4:34,bridge_name='br-int',has_traffic_filtering=True,id=1aad7982-a338-4425-9e53-ea99f31b0de6,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aad7982-a3')
Apr 14 12:02:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Deleting instance files /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29_del
Apr 14 12:02:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Deletion of /opt/stack/data/nova/instances/25eda1c2-9b82-412f-b75d-358e87847a29_del complete
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:52 user nova-compute[71330]: INFO nova.compute.manager [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:53 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '25eda1c2-9b82-412f-b75d-358e87847a29' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '25eda1c2-9b82-412f-b75d-358e87847a29' (instance-0000000a)
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-deleted-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:53 user nova-compute[71330]: INFO nova.compute.manager [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Neutron deleted interface 1aad7982-a338-4425-9e53-ea99f31b0de6; detaching it from the instance and deleting it from the info cache
Apr 14 12:02:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:53 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Took 0.57 seconds to deallocate network for instance.
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Detach interface failed, port_id=1aad7982-a338-4425-9e53-ea99f31b0de6, reason: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Refreshing inventories for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 12:02:53 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:02:53 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:02:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7420MB free_disk=26.191036224365234GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:53 user nova-compute[71330]: INFO nova.compute.manager [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Unrescuing
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquired lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:02:53 user nova-compute[71330]: DEBUG nova.network.neutron [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Updating ProviderTree inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Refreshing aggregate associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, aggregates: None {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Refreshing trait associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] Acquiring lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] Lock "25eda1c2-9b82-412f-b75d-358e87847a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] No waiting events found dispatching network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:54 user nova-compute[71330]: WARNING nova.compute.manager [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Received unexpected event network-vif-plugged-1aad7982-a338-4425-9e53-ea99f31b0de6 for instance with vm_state deleted and task_state None.
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.059s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.523s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:54 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Deleted allocations for instance 25eda1c2-9b82-412f-b75d-358e87847a29
Apr 14 12:02:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "25eda1c2-9b82-412f-b75d-358e87847a29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.079s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 93d16198-833e-4412-99ee-637bcf13624d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:02:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.853s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances with incomplete migration  {{(pid=71330) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG nova.network.neutron [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating instance_info_cache with network_info: [{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Releasing lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG nova.objects.instance [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'flavor' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-changed-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Refreshing instance network info cache due to event network-changed-00a245fe-c22c-48a0-9718-72e81d0ef026. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] Acquiring lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] Acquired lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:02:55 user nova-compute[71330]: DEBUG nova.network.neutron [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Refreshing network info cache for port 00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:02:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Instance destroyed successfully.
Apr 14 12:02:56 user nova-compute[71330]: DEBUG nova.network.neutron [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updated VIF entry in instance network info cache for port 00a245fe-c22c-48a0-9718-72e81d0ef026. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:02:56 user nova-compute[71330]: DEBUG nova.network.neutron [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating instance_info_cache with network_info: [{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] Releasing lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-changed-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Refreshing instance network info cache due to event network-changed-00a245fe-c22c-48a0-9718-72e81d0ef026. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Acquiring lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Acquired lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:02:57 user nova-compute[71330]: DEBUG nova.network.neutron [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Refreshing network info cache for port 00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updated VIF entry in instance network info cache for port 00a245fe-c22c-48a0-9718-72e81d0ef026. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating instance_info_cache with network_info: [{"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Releasing lock "refresh_cache-80b9c47d-7dc8-4bbe-b961-41921a457d98" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-unplugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-unplugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:58 user nova-compute[71330]: WARNING nova.compute.manager [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-unplugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:02:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:02:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:02:58 user nova-compute[71330]: WARNING nova.compute.manager [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:02:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:02:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 80b9c47d-7dc8-4bbe-b961-41921a457d98 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:02:59 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473779.9513416, 80b9c47d-7dc8-4bbe-b961-41921a457d98 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:02:59 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] VM Resumed (Lifecycle Event)
Apr 14 12:02:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:02:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:02:59 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 12:02:59 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473779.9543428, 80b9c47d-7dc8-4bbe-b961-41921a457d98 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:02:59 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] VM Started (Lifecycle Event)
Apr 14 12:03:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:00 user nova-compute[71330]: WARNING nova.compute.manager [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:03:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:00 user nova-compute[71330]: WARNING nova.compute.manager [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:03:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:03:00 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 12:03:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:07 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473772.6190476, 25eda1c2-9b82-412f-b75d-358e87847a29 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:03:07 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] VM Stopped (Lifecycle Event)
Apr 14 12:03:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2de47e3f-b880-4a1e-baea-2ac0aa568578 None None] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:07 user nova-compute[71330]: INFO nova.compute.manager [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Terminating instance
Apr 14 12:03:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received event network-vif-unplugged-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] No waiting events found dispatching network-vif-unplugged-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received event network-vif-unplugged-c9d9e100-59bd-4f58-8892-80c764c88b85 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:03:08 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Instance destroyed successfully.
Apr 14 12:03:08 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'resources' on Instance uuid 47955121-a299-4b9b-aa83-0e55cfb52f4b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1977536204',display_name='tempest-VolumesAdminNegativeTest-server-1977536204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1977536204',id=7,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcMkB0c1UH4Qtwm8SiFLUTXerz4U0APq2enYwPi8/yWkRE0BQ2u6+QDFCAZbkZ1czueB4QHKXGQgV/9QKHiS1kueXwHdrPuJh/RwtOe2sBeAn35kuAmGoqUmSVUTssnzg==',key_name='tempest-keypair-331968736',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1dde7a2b6d498cbb829c51bfafadee',ramdisk_id='',reservation_id='r-emzw46y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1955614665',owner_user_name='tempest-VolumesAdminNegativeTest-1955614665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='390ba60eb6f3478fb8225976ee516218',uuid=47955121-a299-4b9b-aa83-0e55cfb52f4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converting VIF {"id": "c9d9e100-59bd-4f58-8892-80c764c88b85", "address": "fa:16:3e:57:07:30", "network": {"id": "19680b33-4490-481b-8566-09234e2ffa89", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-488407225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1dde7a2b6d498cbb829c51bfafadee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d9e100-59", "ovs_interfaceid": "c9d9e100-59bd-4f58-8892-80c764c88b85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:07:30,bridge_name='br-int',has_traffic_filtering=True,id=c9d9e100-59bd-4f58-8892-80c764c88b85,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d9e100-59') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG os_vif [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:07:30,bridge_name='br-int',has_traffic_filtering=True,id=c9d9e100-59bd-4f58-8892-80c764c88b85,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d9e100-59') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9d9e100-59, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:08 user nova-compute[71330]: INFO os_vif [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:07:30,bridge_name='br-int',has_traffic_filtering=True,id=c9d9e100-59bd-4f58-8892-80c764c88b85,network=Network(19680b33-4490-481b-8566-09234e2ffa89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d9e100-59')
Apr 14 12:03:08 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Deleting instance files /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b_del
Apr 14 12:03:08 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Deletion of /opt/stack/data/nova/instances/47955121-a299-4b9b-aa83-0e55cfb52f4b_del complete
Apr 14 12:03:08 user nova-compute[71330]: INFO nova.compute.manager [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 12:03:08 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:03:08 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:03:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:09 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:03:09 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Took 0.70 seconds to deallocate network for instance.
Apr 14 12:03:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received event network-vif-deleted-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:09 user nova-compute[71330]: INFO nova.compute.manager [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Neutron deleted interface c9d9e100-59bd-4f58-8892-80c764c88b85; detaching it from the instance and deleting it from the info cache
Apr 14 12:03:09 user nova-compute[71330]: DEBUG nova.network.neutron [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:03:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Detach interface failed, port_id=c9d9e100-59bd-4f58-8892-80c764c88b85, reason: Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:03:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:09 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:03:09 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:03:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:09 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Deleted allocations for instance 47955121-a299-4b9b-aa83-0e55cfb52f4b
Apr 14 12:03:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.121s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received event network-vif-plugged-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] Acquiring lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] Lock "47955121-a299-4b9b-aa83-0e55cfb52f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] No waiting events found dispatching network-vif-plugged-c9d9e100-59bd-4f58-8892-80c764c88b85 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:10 user nova-compute[71330]: WARNING nova.compute.manager [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Received unexpected event network-vif-plugged-c9d9e100-59bd-4f58-8892-80c764c88b85 for instance with vm_state deleted and task_state None.
Apr 14 12:03:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-changed-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Refreshing instance network info cache due to event network-changed-d7cd0790-d778-4855-b7ad-c0b5c0258c1b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:03:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] Acquiring lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:03:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] Acquired lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:03:16 user nova-compute[71330]: DEBUG nova.network.neutron [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Refreshing network info cache for port d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:03:16 user nova-compute[71330]: DEBUG nova.network.neutron [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updated VIF entry in instance network info cache for port d7cd0790-d778-4855-b7ad-c0b5c0258c1b. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:03:16 user nova-compute[71330]: DEBUG nova.network.neutron [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:03:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] Releasing lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:03:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:23 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473788.7542088, 47955121-a299-4b9b-aa83-0e55cfb52f4b => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:03:23 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] VM Stopped (Lifecycle Event)
Apr 14 12:03:23 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f419efef-6bac-43f9-a22f-6253940ccddb None None] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:25 user nova-compute[71330]: INFO nova.compute.manager [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Terminating instance
Apr 14 12:03:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received event network-vif-unplugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] Acquiring lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] No waiting events found dispatching network-vif-unplugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received event network-vif-unplugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:03:26 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Instance destroyed successfully.
Apr 14 12:03:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lazy-loading 'resources' on Instance uuid b1b9021d-2463-4267-8cb7-cc1c47d54f77 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1585756320',display_name='tempest-VolumesNegativeTest-instance-1585756320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1585756320',id=16,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:01:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc91a871a3dc4a5a81f6bac70701177b',ramdisk_id='',reservation_id='r-49gj1wcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-992240870',owner_user_name='tempest-VolumesNegativeTest-992240870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:01:43Z,user_data=None,user_id='288a3cdba40944e0b3bb945ba21d2f1d',uuid=b1b9021d-2463-4267-8cb7-cc1c47d54f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Converting VIF {"id": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "address": "fa:16:3e:2e:0d:a4", "network": {"id": "5f6652b6-7efd-4036-a12f-b4b0ddfec55f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2e49c46dbecd4dc3a7c692a647bc7832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10da8-d1", "ovs_interfaceid": "ced10da8-d1f9-48ae-9e76-68c3008018f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0d:a4,bridge_name='br-int',has_traffic_filtering=True,id=ced10da8-d1f9-48ae-9e76-68c3008018f1,network=Network(5f6652b6-7efd-4036-a12f-b4b0ddfec55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10da8-d1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG os_vif [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0d:a4,bridge_name='br-int',has_traffic_filtering=True,id=ced10da8-d1f9-48ae-9e76-68c3008018f1,network=Network(5f6652b6-7efd-4036-a12f-b4b0ddfec55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10da8-d1') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapced10da8-d1, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:26 user nova-compute[71330]: INFO os_vif [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0d:a4,bridge_name='br-int',has_traffic_filtering=True,id=ced10da8-d1f9-48ae-9e76-68c3008018f1,network=Network(5f6652b6-7efd-4036-a12f-b4b0ddfec55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10da8-d1')
Apr 14 12:03:26 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Deleting instance files /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77_del
Apr 14 12:03:26 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Deletion of /opt/stack/data/nova/instances/b1b9021d-2463-4267-8cb7-cc1c47d54f77_del complete
Apr 14 12:03:26 user nova-compute[71330]: INFO nova.compute.manager [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Took 1.08 seconds to destroy the instance on the hypervisor.
Apr 14 12:03:26 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:03:26 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:03:27 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Took 0.56 seconds to deallocate network for instance.
Apr 14 12:03:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-4d53eb0c-3e72-458b-9c85-20cf2f94d09b req-c6dd36af-6356-435c-a6f7-d7cee51edf8a service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received event network-vif-deleted-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:27 user nova-compute[71330]: INFO nova.compute.manager [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Detaching volume d987d86e-92eb-4c3d-a537-909b62392bff
Apr 14 12:03:27 user nova-compute[71330]: INFO nova.virt.block_device [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Attempting to driver detach volume d987d86e-92eb-4c3d-a537-909b62392bff from mountpoint /dev/vdb
Apr 14 12:03:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Attempting to detach device vdb from instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:03:27 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:03:27 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:03:27 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:03:27 user nova-compute[71330]:   <serial>d987d86e-92eb-4c3d-a537-909b62392bff</serial>
Apr 14 12:03:27 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:03:27 user nova-compute[71330]: </disk>
Apr 14 12:03:27 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:03:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Successfully detached device vdb from instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 from the persistent domain config.
Apr 14 12:03:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:03:27 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:03:27 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:03:27 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:03:27 user nova-compute[71330]:   <serial>d987d86e-92eb-4c3d-a537-909b62392bff</serial>
Apr 14 12:03:27 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:03:27 user nova-compute[71330]: </disk>
Apr 14 12:03:27 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:27 user nova-compute[71330]: INFO nova.compute.manager [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Terminating instance
Apr 14 12:03:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:27 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Deleted allocations for instance b1b9021d-2463-4267-8cb7-cc1c47d54f77
Apr 14 12:03:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.233s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received event network-vif-plugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] Acquiring lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] Lock "b1b9021d-2463-4267-8cb7-cc1c47d54f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] No waiting events found dispatching network-vif-plugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:28 user nova-compute[71330]: WARNING nova.compute.manager [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Received unexpected event network-vif-plugged-ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance with vm_state deleted and task_state None.
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-unplugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] No waiting events found dispatching network-vif-unplugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-unplugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473808.2484818, 80b9c47d-7dc8-4bbe-b961-41921a457d98 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:03:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Successfully detached device vdb from instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 from the live domain config.
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYINHwts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:03:28 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[68528825-286c-4d7c-8e6c-dc3fe5e14121]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:03:28 user nova-compute[71330]: No targets found.
Apr 14 12:03:28 user nova-compute[71330]: iSNS:
Apr 14 12:03:28 user nova-compute[71330]: No targets found.
Apr 14 12:03:28 user nova-compute[71330]: STATIC:
Apr 14 12:03:28 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:03:28 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:03:28 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:03:28 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff
Apr 14 12:03:28 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:03:28 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:03:28 user nova-compute[71330]: FIRMWARE:
Apr 14 12:03:28 user nova-compute[71330]: No targets found.
Apr 14 12:03:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:03:28 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:03:28 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[24295d57-2b1a-499f-9c33-355f23d53cc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f484f5dc-bf61-45c0-9db3-4570b3dc075f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:03:28 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:03:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff (non-flash)
Apr 14 12:03:28 user nova-compute[71330]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:03:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4954241c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6262e0da-87dc-4406-a4d8-bde45cc0b45a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb2f40-060e-4a81-9d28-58a664e899fc]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84739ef-7469-4368-be01-593337eb2885]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[185d95c0-50ac-4c45-8f4f-24a54ce319bb]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[966d1c9e-bef8-4404-8a60-d738913aa76d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f809503-0f05-4b24-87d4-143c28b89b49]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff, portal: 172.16.0.220,3260]
Apr 14 12:03:28 user nova-compute[71330]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff, portal: 172.16.0.220,3260] successful.
Apr 14 12:03:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d987d86e-92eb-4c3d-a537-909b62392bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9077164c-4f55-433b-b1ab-a59c35c3ac11]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] <== disconnect_volume: return (312ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:03:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Instance destroyed successfully.
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'resources' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T11:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373523786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373523786',id=4,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsyIPWrTgYx5mDYmYLAUYql9c5ytzflRJOI8xt+Liz9SO5uhpL9//IuWHW3+gSIh0I3JxFjHbVn4FDFn00auhiTq2XJaAhJLeaQLZujkXhytUWDHfKLlHryI1f/amUc4g==',key_name='tempest-keypair-1689899826',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-fmqjkid5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=ad7c2f89-c54f-4e78-b86d-88b4ab5daff4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "address": "fa:16:3e:19:43:63", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea071f4-a3", "ovs_interfaceid": "7ea071f4-a31f-4eb6-b79b-971106d2c33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG os_vif [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ea071f4-a3, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:03:28 user nova-compute[71330]: INFO os_vif [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:43:63,bridge_name='br-int',has_traffic_filtering=True,id=7ea071f4-a31f-4eb6-b79b-971106d2c33e,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea071f4-a3')
Apr 14 12:03:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Deleting instance files /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4_del
Apr 14 12:03:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Deletion of /opt/stack/data/nova/instances/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4_del complete
Apr 14 12:03:28 user nova-compute[71330]: INFO nova.compute.manager [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 12:03:28 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:03:28 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:03:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:29 user nova-compute[71330]: DEBUG nova.objects.instance [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'flavor' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:03:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.792s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:29 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:03:29 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Took 0.85 seconds to deallocate network for instance.
Apr 14 12:03:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-49878aae-5c71-495c-a16f-976bce64360f req-59aebfc0-9ab6-464c-8ff5-eb6b74cb5af5 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-deleted-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:29 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:03:29 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:03:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:29 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Deleted allocations for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4
Apr 14 12:03:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:30 user nova-compute[71330]: INFO nova.compute.manager [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Unrescuing
Apr 14 12:03:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:03:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquired lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:03:30 user nova-compute[71330]: DEBUG nova.network.neutron [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:03:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] Acquiring lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] Lock "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] No waiting events found dispatching network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:30 user nova-compute[71330]: WARNING nova.compute.manager [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Received unexpected event network-vif-plugged-7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance with vm_state deleted and task_state None.
Apr 14 12:03:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updating instance_info_cache with network_info: [{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Releasing lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG nova.objects.instance [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'flavor' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-unplugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-unplugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:31 user nova-compute[71330]: WARNING nova.compute.manager [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-unplugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:03:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:31 user nova-compute[71330]: WARNING nova.compute.manager [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:03:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:31 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Instance destroyed successfully.
Apr 14 12:03:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:33 user nova-compute[71330]: WARNING nova.compute.manager [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:03:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 16a25a1d-bc8b-4de0-b975-037aee0d46ee due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473815.6137261, 16a25a1d-bc8b-4de0-b975-037aee0d46ee => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:03:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] VM Resumed (Lifecycle Event)
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:03:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473815.6158683, 16a25a1d-bc8b-4de0-b975-037aee0d46ee => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:03:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] VM Started (Lifecycle Event)
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:35 user nova-compute[71330]: WARNING nova.compute.manager [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state active and task_state None.
Apr 14 12:03:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:41 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473806.5114706, b1b9021d-2463-4267-8cb7-cc1c47d54f77 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:03:41 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] VM Stopped (Lifecycle Event)
Apr 14 12:03:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-bc7b8b15-4591-469b-974a-ec1d278a4f59 None None] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:43 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473808.6073444, ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:03:43 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] VM Stopped (Lifecycle Event)
Apr 14 12:03:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b97cbe46-b979-4039-83bd-dc2e21c1dce7 None None] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updating instance_info_cache with network_info: [{"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_power_states {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 3a308eef-321e-45c9-bc63-f99c4eacef85 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid ba2689ad-6a47-45c2-b5db-bec9e5a152ac {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 93d16198-833e-4412-99ee-637bcf13624d {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "3a308eef-321e-45c9-bc63-f99c4eacef85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "fcd74f51-099e-4c19-af7d-912f622fb153" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "93d16198-833e-4412-99ee-637bcf13624d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "93d16198-833e-4412-99ee-637bcf13624d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "fcd74f51-099e-4c19-af7d-912f622fb153" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:03:45 user nova-compute[71330]: INFO nova.compute.claims [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Claim successful on node user
Apr 14 12:03:45 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:03:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:03:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:03:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG nova.policy [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:03:46 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Creating image(s)
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "/opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "/opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "/opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "f63d351389b409ff33e2436805b24bf043db0518" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "f63d351389b409ff33e2436805b24bf043db0518" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG nova.virt.images [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 3e365d0f-5c6c-4685-b457-90f08aed34f3 was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518.part /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518.part /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518.converted" returned: 0 in 0.170s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG nova.network.neutron [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Successfully created port: a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "f63d351389b409ff33e2436805b24bf043db0518" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.778s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518 --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "f63d351389b409ff33e2436805b24bf043db0518" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "f63d351389b409ff33e2436805b24bf043db0518" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518 --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518,backing_fmt=raw /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518,backing_fmt=raw /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk 1073741824" returned: 0 in 0.053s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "f63d351389b409ff33e2436805b24bf043db0518" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518 --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Successfully updated port: a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Cannot resize image /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'migration_context' on Instance uuid 075f81e9-8b43-4b05-96be-6eb4cca6d812 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquired lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Ensure instance console log exists: /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing instance network info cache due to event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] Acquiring lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updating instance_info_cache with network_info: [{"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Releasing lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Instance network_info: |[{"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] Acquired lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.network.neutron [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Start _get_guest_xml network_info=[{"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T12:03:43Z,direct_url=<?>,disk_format='qcow2',id=3e365d0f-5c6c-4685-b457-90f08aed34f3,min_disk=0,min_ram=0,name='tempest-scenario-img--535045747',owner='cd9936aa363942f6a01bb64a8a8e74c9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T12:03:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '3e365d0f-5c6c-4685-b457-90f08aed34f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:03:47 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:03:47 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T12:03:43Z,direct_url=<?>,disk_format='qcow2',id=3e365d0f-5c6c-4685-b457-90f08aed34f3,min_disk=0,min_ram=0,name='tempest-scenario-img--535045747',owner='cd9936aa363942f6a01bb64a8a8e74c9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T12:03:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-547707512',display_name='tempest-TestMinimumBasicScenario-server-547707512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-547707512',id=19,image_ref='3e365d0f-5c6c-4685-b457-90f08aed34f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7XKwiLURj1b5DcTPIVltofftkFGkMimaP6U6s5L9tKtbMKTAUfGzDVvjquRa1/D5ZC1MIwS3Ey8mqJF+pxbMc2DT2o0F12fH+EYHR0P8dd1BBqsgvlbTWVDPzdYVfF1A==',key_name='tempest-TestMinimumBasicScenario-1755081879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd9936aa363942f6a01bb64a8a8e74c9',ramdisk_id='',reservation_id='r-5dreax2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3e365d0f-5c6c-4685-b457-90f08aed34f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-881161311',owner_user_name='tempest-TestMinimumBasicScenario-881161311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:03:46Z,user_data=None,user_id='2eb32a03e7e04da18568294cca0e69bd',uuid=075f81e9-8b43-4b05-96be-6eb4cca6d812,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converting VIF {"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5e:1a,bridge_name='br-int',has_traffic_filtering=True,id=a8047706-f64e-47f2-bb99-b1e66dbd2df8,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8047706-f6') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'pci_devices' on Instance uuid 075f81e9-8b43-4b05-96be-6eb4cca6d812 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:03:47 user nova-compute[71330]:   <uuid>075f81e9-8b43-4b05-96be-6eb4cca6d812</uuid>
Apr 14 12:03:47 user nova-compute[71330]:   <name>instance-00000013</name>
Apr 14 12:03:47 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:03:47 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:03:47 user nova-compute[71330]:   <metadata>
Apr 14 12:03:47 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:03:47 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:03:47 user nova-compute[71330]:       <nova:name>tempest-TestMinimumBasicScenario-server-547707512</nova:name>
Apr 14 12:03:47 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:03:47</nova:creationTime>
Apr 14 12:03:47 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:03:47 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:03:47 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:03:47 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:03:47 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:03:47 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:03:47 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:03:47 user nova-compute[71330]:       <nova:owner>
Apr 14 12:03:47 user nova-compute[71330]:         <nova:user uuid="2eb32a03e7e04da18568294cca0e69bd">tempest-TestMinimumBasicScenario-881161311-project-member</nova:user>
Apr 14 12:03:47 user nova-compute[71330]:         <nova:project uuid="cd9936aa363942f6a01bb64a8a8e74c9">tempest-TestMinimumBasicScenario-881161311</nova:project>
Apr 14 12:03:47 user nova-compute[71330]:       </nova:owner>
Apr 14 12:03:47 user nova-compute[71330]:       <nova:root type="image" uuid="3e365d0f-5c6c-4685-b457-90f08aed34f3"/>
Apr 14 12:03:47 user nova-compute[71330]:       <nova:ports>
Apr 14 12:03:47 user nova-compute[71330]:         <nova:port uuid="a8047706-f64e-47f2-bb99-b1e66dbd2df8">
Apr 14 12:03:47 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 12:03:47 user nova-compute[71330]:         </nova:port>
Apr 14 12:03:47 user nova-compute[71330]:       </nova:ports>
Apr 14 12:03:47 user nova-compute[71330]:     </nova:instance>
Apr 14 12:03:47 user nova-compute[71330]:   </metadata>
Apr 14 12:03:47 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:03:47 user nova-compute[71330]:     <system>
Apr 14 12:03:47 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:03:47 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:03:47 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:03:47 user nova-compute[71330]:       <entry name="serial">075f81e9-8b43-4b05-96be-6eb4cca6d812</entry>
Apr 14 12:03:47 user nova-compute[71330]:       <entry name="uuid">075f81e9-8b43-4b05-96be-6eb4cca6d812</entry>
Apr 14 12:03:47 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:03:47 user nova-compute[71330]:     </system>
Apr 14 12:03:47 user nova-compute[71330]:   </sysinfo>
Apr 14 12:03:47 user nova-compute[71330]:   <os>
Apr 14 12:03:47 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:03:47 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:03:47 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:03:47 user nova-compute[71330]:   </os>
Apr 14 12:03:47 user nova-compute[71330]:   <features>
Apr 14 12:03:47 user nova-compute[71330]:     <acpi/>
Apr 14 12:03:47 user nova-compute[71330]:     <apic/>
Apr 14 12:03:47 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:03:47 user nova-compute[71330]:   </features>
Apr 14 12:03:47 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:03:47 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:03:47 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:03:47 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:03:47 user nova-compute[71330]:   </clock>
Apr 14 12:03:47 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:03:47 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:03:47 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:03:47 user nova-compute[71330]:   </cpu>
Apr 14 12:03:47 user nova-compute[71330]:   <devices>
Apr 14 12:03:47 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:03:47 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:03:47 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk"/>
Apr 14 12:03:47 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:03:47 user nova-compute[71330]:     </disk>
Apr 14 12:03:47 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:03:47 user nova-compute[71330]:       <mac address="fa:16:3e:db:5e:1a"/>
Apr 14 12:03:47 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:03:47 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:03:47 user nova-compute[71330]:       <target dev="tapa8047706-f6"/>
Apr 14 12:03:47 user nova-compute[71330]:     </interface>
Apr 14 12:03:47 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:03:47 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/console.log" append="off"/>
Apr 14 12:03:47 user nova-compute[71330]:     </serial>
Apr 14 12:03:47 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:03:47 user nova-compute[71330]:     <video>
Apr 14 12:03:47 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:03:47 user nova-compute[71330]:     </video>
Apr 14 12:03:47 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:03:47 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:03:47 user nova-compute[71330]:     </rng>
Apr 14 12:03:47 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:03:47 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:03:47 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:03:47 user nova-compute[71330]:     </memballoon>
Apr 14 12:03:47 user nova-compute[71330]:   </devices>
Apr 14 12:03:47 user nova-compute[71330]: </domain>
Apr 14 12:03:47 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-547707512',display_name='tempest-TestMinimumBasicScenario-server-547707512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-547707512',id=19,image_ref='3e365d0f-5c6c-4685-b457-90f08aed34f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7XKwiLURj1b5DcTPIVltofftkFGkMimaP6U6s5L9tKtbMKTAUfGzDVvjquRa1/D5ZC1MIwS3Ey8mqJF+pxbMc2DT2o0F12fH+EYHR0P8dd1BBqsgvlbTWVDPzdYVfF1A==',key_name='tempest-TestMinimumBasicScenario-1755081879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd9936aa363942f6a01bb64a8a8e74c9',ramdisk_id='',reservation_id='r-5dreax2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3e365d0f-5c6c-4685-b457-90f08aed34f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-881161311',owner_user_name='tempest-TestMinimumBasicScenario-881161311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:03:46Z,user_data=None,user_id='2eb32a03e7e04da18568294cca0e69bd',uuid=075f81e9-8b43-4b05-96be-6eb4cca6d812,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converting VIF {"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5e:1a,bridge_name='br-int',has_traffic_filtering=True,id=a8047706-f64e-47f2-bb99-b1e66dbd2df8,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8047706-f6') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG os_vif [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5e:1a,bridge_name='br-int',has_traffic_filtering=True,id=a8047706-f64e-47f2-bb99-b1e66dbd2df8,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8047706-f6') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8047706-f6, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8047706-f6, col_values=(('external_ids', {'iface-id': 'a8047706-f64e-47f2-bb99-b1e66dbd2df8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:5e:1a', 'vm-uuid': '075f81e9-8b43-4b05-96be-6eb4cca6d812'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:03:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:47 user nova-compute[71330]: INFO os_vif [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5e:1a,bridge_name='br-int',has_traffic_filtering=True,id=a8047706-f64e-47f2-bb99-b1e66dbd2df8,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8047706-f6')
Apr 14 12:03:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:03:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No VIF found with MAC fa:16:3e:db:5e:1a, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:03:48 user nova-compute[71330]: DEBUG nova.network.neutron [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updated VIF entry in instance network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:03:48 user nova-compute[71330]: DEBUG nova.network.neutron [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updating instance_info_cache with network_info: [{"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:03:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] Releasing lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] No waiting events found dispatching network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:49 user nova-compute[71330]: WARNING nova.compute.manager [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received unexpected event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance with vm_state building and task_state spawning.
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473831.4198322, 075f81e9-8b43-4b05-96be-6eb4cca6d812 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:03:51 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] VM Resumed (Lifecycle Event)
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:03:51 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Instance spawned successfully.
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:03:51 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473831.4325106, 075f81e9-8b43-4b05-96be-6eb4cca6d812 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:03:51 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] VM Started (Lifecycle Event)
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:51 user nova-compute[71330]: INFO nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Took 5.49 seconds to spawn the instance on the hypervisor.
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:03:51 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] No waiting events found dispatching network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:03:51 user nova-compute[71330]: WARNING nova.compute.manager [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received unexpected event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance with vm_state building and task_state spawning.
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:51 user nova-compute[71330]: INFO nova.compute.manager [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Took 6.22 seconds to build instance.
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.333s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:03:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:53 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:03:53 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=26.241832733154297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 93d16198-833e-4412-99ee-637bcf13624d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:03:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:03:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:03:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-changed-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Refreshing instance network info cache due to event network-changed-fd5df68e-d97d-41be-a98a-d5d7b77a0044. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] Acquiring lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] Acquired lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Refreshing network info cache for port fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'flavor' on Instance uuid ba2689ad-6a47-45c2-b5db-bec9e5a152ac {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:10 user nova-compute[71330]: INFO nova.compute.manager [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Attaching volume 26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 to /dev/vdb
Apr 14 12:04:10 user nova-compute[71330]: DEBUG os_brick.utils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updated VIF entry in instance network info cache for port fd5df68e-d97d-41be-a98a-d5d7b77a0044. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updating instance_info_cache with network_info: [{"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c39f6-0c8e-4c6d-b456-eeb04066358e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] Releasing lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41edb99-62b7-4427-816d-86332e50644e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8008b65d-61cd-4373-ab24-2f20735445ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb690e4-1a6a-48eb-9a50-4c353bd60c74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:04:10 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:04:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ae750b-0a89-4f69-95d7-05d61b53fba8]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG os_brick.utils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:04:10 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updating existing volume attachment record: 81221ab6-cf38-466f-9aa5-7b919e28e68f {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:04:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxcHbygd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:04:15 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:04:15 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:04:15 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0945f8-46ec-4768-85c7-ddab42647388]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:04:15 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd962702-b76b-455c-ab0c-dee0f0a733cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9] added
Apr 14 12:04:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f8f0b3-ed09-4dc2-be49-a0955c7bf3af]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[987dc3f0-f25f-4a38-bf92-b3a8f9249ba1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxcHbygd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxcHbygd" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edab7e4-071c-48c8-85f2-2ee0e4913c7d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SxcHbygd'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5929b021-1454-4fcb-90e6-2da849034e1b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc729776-f7e3-4aa8-ab8c-c1fbecd6430d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b633d1-2875-44ad-b32e-9677d641995e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9, portal: 172.16.0.220,3260]
Apr 14 12:04:15 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9, portal: 172.16.0.220,3260] successful.
Apr 14 12:04:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e1f55a-08c1-4c45-9dc8-3557e1dedb4a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[61265cef-da4e-419f-92b8-c4ff74d5b69f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:15 user nova-compute[71330]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 (non-flash)
Apr 14 12:04:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:15 user nova-compute[71330]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 (non-flash)
Apr 14 12:04:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[923c6d64-6213-45ec-aa2b-6bedb57557ae]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:04:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxcHbygd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:04:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:04:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26136353832343230', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:04:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136353832343230', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:04:16 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'flavor' on Instance uuid ba2689ad-6a47-45c2-b5db-bec9e5a152ac {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:04:16 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:04:16 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:04:16 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:04:16 user nova-compute[71330]:   <serial>26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9</serial>
Apr 14 12:04:16 user nova-compute[71330]: </disk>
Apr 14 12:04:16 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:04:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:04:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:04:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No VIF found with MAC fa:16:3e:88:52:4c, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:04:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.773s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:19 user nova-compute[71330]: INFO nova.compute.manager [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Detaching volume 26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9
Apr 14 12:04:19 user nova-compute[71330]: INFO nova.virt.block_device [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Attempting to driver detach volume 26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 from mountpoint /dev/vdb
Apr 14 12:04:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Attempting to detach device vdb from instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:04:19 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:04:19 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:04:19 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:04:19 user nova-compute[71330]:   <serial>26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9</serial>
Apr 14 12:04:19 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:04:19 user nova-compute[71330]: </disk>
Apr 14 12:04:19 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:04:19 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Successfully detached device vdb from instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac from the persistent domain config.
Apr 14 12:04:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:04:19 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:04:19 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:04:19 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:04:19 user nova-compute[71330]:   <serial>26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9</serial>
Apr 14 12:04:19 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:04:19 user nova-compute[71330]: </disk>
Apr 14 12:04:19 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473859.9631612, ba2689ad-6a47-45c2-b5db-bec9e5a152ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:04:19 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Successfully detached device vdb from instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac from the live domain config.
Apr 14 12:04:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxcHbygd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:04:19 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:04:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[76523d78-2c84-4a89-8d66-c1b694b212ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:04:20 user nova-compute[71330]: No targets found.
Apr 14 12:04:20 user nova-compute[71330]: iSNS:
Apr 14 12:04:20 user nova-compute[71330]: No targets found.
Apr 14 12:04:20 user nova-compute[71330]: STATIC:
Apr 14 12:04:20 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9
Apr 14 12:04:20 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:04:20 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:04:20 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:04:20 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:04:20 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:04:20 user nova-compute[71330]: FIRMWARE:
Apr 14 12:04:20 user nova-compute[71330]: No targets found.
Apr 14 12:04:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:04:20 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:04:20 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[899d8ba7-8551-4904-8eb6-81346555e667]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[675521d9-0bb5-4356-aecc-ada0117e0e96]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:20 user nova-compute[71330]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 (non-flash)
Apr 14 12:04:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:20 user nova-compute[71330]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 (non-flash)
Apr 14 12:04:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495c3e4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[03127679-96a7-477a-b00c-17297b2efbf9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99341af-95fe-49af-966e-14629e28e270]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a65922-2b7e-4baf-acf7-51c0b235a913]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd7164-db48-4d69-9a03-f16976eed2eb]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4436de-f0f3-44b3-939c-3c17606d6e76]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[366d31e7-d14e-42c6-8a36-22e2982d5360]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9, portal: 172.16.0.220,3260]
Apr 14 12:04:20 user nova-compute[71330]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9, portal: 172.16.0.220,3260] successful.
Apr 14 12:04:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2701a7e1-79dd-4430-aa34-6f1e9144d3cb]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] <== disconnect_volume: return (343ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'flavor' on Instance uuid 93d16198-833e-4412-99ee-637bcf13624d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Ignoring supplied device name: /dev/vdb
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:20 user nova-compute[71330]: INFO nova.compute.manager [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Attaching volume 2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 to /dev/vdb
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.utils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e020a005-a760-4d85-9c7b-8c74d53db9e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[337e856d-1529-4300-9540-1e60e82f48ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6aa23-41c0-4b9d-8f2c-cfc6b29c8661]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a5bc16-599c-4a4f-956d-224dc7bee2e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:04:20 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:04:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba39963-2398-421c-87f3-97bf107a025e]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG os_brick.utils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:04:20 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Updating existing volume attachment record: fe8fbf77-d525-4d77-b51f-372539edc203 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG nova.objects.instance [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'flavor' on Instance uuid ba2689ad-6a47-45c2-b5db-bec9e5a152ac {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.926s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:21 user nova-compute[71330]: INFO nova.compute.manager [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Terminating instance
Apr 14 12:04:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-unplugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-unplugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-unplugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:04:22 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Instance destroyed successfully.
Apr 14 12:04:22 user nova-compute[71330]: DEBUG nova.objects.instance [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'resources' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1793780522',display_name='tempest-ServerStableDeviceRescueTest-server-1793780522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1793780522',id=5,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXuDQX5mdlneSOlaQfy+4JxDU0auroTMJCiqenRoOw2yfCd/60N23lq489zSoPdy+CApif7xFXMGBg0JnCYtsNCRaca1mNN0lFB5bW9+TQVJK0zLh1rtz82y9q/SaEasg==',key_name='tempest-keypair-438477400',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:01:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b3564d4d9634e469520a3deebe14ab6',ramdisk_id='',reservation_id='r-p9k52wkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1361865083',owner_user_name='tempest-ServerStableDeviceRescueTest-1361865083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2c1e52acc8496f8f56c82fbce51105',uuid=80b9c47d-7dc8-4bbe-b961-41921a457d98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Converting VIF {"id": "00a245fe-c22c-48a0-9718-72e81d0ef026", "address": "fa:16:3e:b7:fb:9f", "network": {"id": "f01a9b31-3529-47ab-bd37-1b80abdf9e67", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1598888958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b3564d4d9634e469520a3deebe14ab6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a245fe-c2", "ovs_interfaceid": "00a245fe-c22c-48a0-9718-72e81d0ef026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fb:9f,bridge_name='br-int',has_traffic_filtering=True,id=00a245fe-c22c-48a0-9718-72e81d0ef026,network=Network(f01a9b31-3529-47ab-bd37-1b80abdf9e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a245fe-c2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG os_vif [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fb:9f,bridge_name='br-int',has_traffic_filtering=True,id=00a245fe-c22c-48a0-9718-72e81d0ef026,network=Network(f01a9b31-3529-47ab-bd37-1b80abdf9e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a245fe-c2') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00a245fe-c2, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:22 user nova-compute[71330]: INFO os_vif [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fb:9f,bridge_name='br-int',has_traffic_filtering=True,id=00a245fe-c22c-48a0-9718-72e81d0ef026,network=Network(f01a9b31-3529-47ab-bd37-1b80abdf9e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a245fe-c2')
Apr 14 12:04:22 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Deleting instance files /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98_del
Apr 14 12:04:22 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Deletion of /opt/stack/data/nova/instances/80b9c47d-7dc8-4bbe-b961-41921a457d98_del complete
Apr 14 12:04:22 user nova-compute[71330]: INFO nova.compute.manager [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 12:04:22 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:22 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:04:22 user nova-compute[71330]: INFO nova.compute.claims [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Claim successful on node user
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.network.neutron [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:04:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:04:23 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Took 0.86 seconds to deallocate network for instance.
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.policy [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:04:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Creating image(s)
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk 1073741824" returned: 0 in 0.067s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:23 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Deleted allocations for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Cannot resize image /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG nova.objects.instance [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'migration_context' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Ensure instance console log exists: /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] Acquiring lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] Lock "80b9c47d-7dc8-4bbe-b961-41921a457d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] No waiting events found dispatching network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:24 user nova-compute[71330]: WARNING nova.compute.manager [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received unexpected event network-vif-plugged-00a245fe-c22c-48a0-9718-72e81d0ef026 for instance with vm_state deleted and task_state None.
Apr 14 12:04:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Received event network-vif-deleted-00a245fe-c22c-48a0-9718-72e81d0ef026 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:24 user nova-compute[71330]: DEBUG nova.network.neutron [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Successfully created port: 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Successfully updated port: 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquired lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updating instance_info_cache with network_info: [{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZlxsoIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:04:25 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:04:25 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:04:25 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Releasing lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance network_info: |[{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Start _get_guest_xml network_info=[{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:04:25 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:04:25 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-549197077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-549197077',id=20,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhVkEGSeuEZ8Y3htZW1HZinPHvrQPcgejbT/OFh6MfFN2VsnJTbLJi/gTpjMXD41LAKZDrh6KlePbKIa4x2/AbhT90RWYLa4yStEwS5RH7EDrtgqbiBmKAuxLp4/ClApA==',key_name='tempest-keypair-230816513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-q4keusmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:04:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=5181aed1-2933-4b33-893e-eb30a0d4ff4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.objects.instance [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'pci_devices' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82cb0af-6171-41a0-921d-338036542620]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:04:25 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:04:25 user nova-compute[71330]:   <uuid>5181aed1-2933-4b33-893e-eb30a0d4ff4c</uuid>
Apr 14 12:04:25 user nova-compute[71330]:   <name>instance-00000014</name>
Apr 14 12:04:25 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:04:25 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:04:25 user nova-compute[71330]:   <metadata>
Apr 14 12:04:25 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:04:25 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:04:25 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-549197077</nova:name>
Apr 14 12:04:25 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:04:25</nova:creationTime>
Apr 14 12:04:25 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:04:25 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:04:25 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:04:25 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:04:25 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:04:25 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:04:25 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:04:25 user nova-compute[71330]:       <nova:owner>
Apr 14 12:04:25 user nova-compute[71330]:         <nova:user uuid="260d1d4ef5a1422f84f9d91224b53952">tempest-AttachVolumeShelveTestJSON-1457966394-project-member</nova:user>
Apr 14 12:04:25 user nova-compute[71330]:         <nova:project uuid="cc13fb093d2745e8ba0152533140b6f2">tempest-AttachVolumeShelveTestJSON-1457966394</nova:project>
Apr 14 12:04:25 user nova-compute[71330]:       </nova:owner>
Apr 14 12:04:25 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:04:25 user nova-compute[71330]:       <nova:ports>
Apr 14 12:04:25 user nova-compute[71330]:         <nova:port uuid="923fca3f-14a0-481e-8c0c-6cb7cc7a04bb">
Apr 14 12:04:25 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 12:04:25 user nova-compute[71330]:         </nova:port>
Apr 14 12:04:25 user nova-compute[71330]:       </nova:ports>
Apr 14 12:04:25 user nova-compute[71330]:     </nova:instance>
Apr 14 12:04:25 user nova-compute[71330]:   </metadata>
Apr 14 12:04:25 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:04:25 user nova-compute[71330]:     <system>
Apr 14 12:04:25 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:04:25 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:04:25 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:04:25 user nova-compute[71330]:       <entry name="serial">5181aed1-2933-4b33-893e-eb30a0d4ff4c</entry>
Apr 14 12:04:25 user nova-compute[71330]:       <entry name="uuid">5181aed1-2933-4b33-893e-eb30a0d4ff4c</entry>
Apr 14 12:04:25 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:04:25 user nova-compute[71330]:     </system>
Apr 14 12:04:25 user nova-compute[71330]:   </sysinfo>
Apr 14 12:04:25 user nova-compute[71330]:   <os>
Apr 14 12:04:25 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:04:25 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:04:25 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:04:25 user nova-compute[71330]:   </os>
Apr 14 12:04:25 user nova-compute[71330]:   <features>
Apr 14 12:04:25 user nova-compute[71330]:     <acpi/>
Apr 14 12:04:25 user nova-compute[71330]:     <apic/>
Apr 14 12:04:25 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:04:25 user nova-compute[71330]:   </features>
Apr 14 12:04:25 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:04:25 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:04:25 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:04:25 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:04:25 user nova-compute[71330]:   </clock>
Apr 14 12:04:25 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:04:25 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:04:25 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:04:25 user nova-compute[71330]:   </cpu>
Apr 14 12:04:25 user nova-compute[71330]:   <devices>
Apr 14 12:04:25 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:04:25 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:04:25 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk"/>
Apr 14 12:04:25 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:04:25 user nova-compute[71330]:     </disk>
Apr 14 12:04:25 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:04:25 user nova-compute[71330]:       <mac address="fa:16:3e:9e:4c:1c"/>
Apr 14 12:04:25 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:04:25 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:04:25 user nova-compute[71330]:       <target dev="tap923fca3f-14"/>
Apr 14 12:04:25 user nova-compute[71330]:     </interface>
Apr 14 12:04:25 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:04:25 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/console.log" append="off"/>
Apr 14 12:04:25 user nova-compute[71330]:     </serial>
Apr 14 12:04:25 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:04:25 user nova-compute[71330]:     <video>
Apr 14 12:04:25 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:04:25 user nova-compute[71330]:     </video>
Apr 14 12:04:25 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:04:25 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:04:25 user nova-compute[71330]:     </rng>
Apr 14 12:04:25 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:04:25 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:04:25 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:04:25 user nova-compute[71330]:     </memballoon>
Apr 14 12:04:25 user nova-compute[71330]:   </devices>
Apr 14 12:04:25 user nova-compute[71330]: </domain>
Apr 14 12:04:25 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-549197077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-549197077',id=20,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhVkEGSeuEZ8Y3htZW1HZinPHvrQPcgejbT/OFh6MfFN2VsnJTbLJi/gTpjMXD41LAKZDrh6KlePbKIa4x2/AbhT90RWYLa4yStEwS5RH7EDrtgqbiBmKAuxLp4/ClApA==',key_name='tempest-keypair-230816513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-q4keusmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:04:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=5181aed1-2933-4b33-893e-eb30a0d4ff4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_vif [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap923fca3f-14, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap923fca3f-14, col_values=(('external_ids', {'iface-id': '923fca3f-14a0-481e-8c0c-6cb7cc7a04bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:4c:1c', 'vm-uuid': '5181aed1-2933-4b33-893e-eb30a0d4ff4c'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d855984-cd5b-4ca3-96bc-41e233a267d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7] added
Apr 14 12:04:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:25 user nova-compute[71330]: INFO os_vif [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14')
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e16ebc8-57c4-4188-ab6b-84fcd418ad02]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[df16c6bb-eccc-4eea-87c3-73702d5e3568]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZlxsoIg {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZlxsoIg" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f2e23-b98b-4bc7-867e-f16ca102e9fb]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TZlxsoIg'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] No VIF found with MAC fa:16:3e:9e:4c:1c, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c993f-b9c7-411b-8821-482bb326a33d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4e35fc-39ea-42d6-a5eb-82e28ee19acc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:26 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:26 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0183efc-c4c0-4778-9ddf-8156852855d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7, portal: 172.16.0.220,3260]
Apr 14 12:04:26 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7, portal: 172.16.0.220,3260] successful.
Apr 14 12:04:26 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa89c3a-3ac5-4c65-b44b-0c1c3fc389de]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaf8c56-1167-49b9-b1c7-75d5654c4a74]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:26 user nova-compute[71330]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 (non-flash)
Apr 14 12:04:26 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:26 user nova-compute[71330]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 (non-flash)
Apr 14 12:04:26 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74e92f7-e61c-442c-9294-bf7adfd30a9b]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-changed-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Refreshing instance network info cache due to event network-changed-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] Acquiring lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] Acquired lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG nova.network.neutron [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Refreshing network info cache for port 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG nova.network.neutron [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updated VIF entry in instance network info cache for port 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG nova.network.neutron [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updating instance_info_cache with network_info: [{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:04:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] Releasing lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZlxsoIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23262666162366133', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262666162366133', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'flavor' on Instance uuid 93d16198-833e-4412-99ee-637bcf13624d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:04:27 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:04:27 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:04:27 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:04:27 user nova-compute[71330]:   <serial>2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7</serial>
Apr 14 12:04:27 user nova-compute[71330]: </disk>
Apr 14 12:04:27 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No VIF found with MAC fa:16:3e:35:c3:1e, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:04:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.316s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:28 user nova-compute[71330]: WARNING nova.compute.manager [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state building and task_state spawning.
Apr 14 12:04:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:28 user nova-compute[71330]: WARNING nova.compute.manager [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state building and task_state spawning.
Apr 14 12:04:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:04:29 user nova-compute[71330]: INFO nova.compute.claims [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Claim successful on node user
Apr 14 12:04:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:04:29 user nova-compute[71330]: DEBUG nova.network.neutron [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:04:29 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:04:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.policy [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473870.1227443, 5181aed1-2933-4b33-893e-eb30a0d4ff4c => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:04:30 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] VM Resumed (Lifecycle Event)
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:04:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance spawned successfully.
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:04:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Creating image(s)
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:30 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473870.123301, 5181aed1-2933-4b33-893e-eb30a0d4ff4c => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:04:30 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] VM Started (Lifecycle Event)
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:04:30 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:04:30 user nova-compute[71330]: INFO nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Took 6.86 seconds to spawn the instance on the hypervisor.
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.170s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:30 user nova-compute[71330]: INFO nova.compute.manager [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Took 7.75 seconds to build instance.
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.871s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.164s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk 1073741824" returned: 0 in 0.056s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.165s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Cannot resize image /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.objects.instance [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'migration_context' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Ensure instance console log exists: /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Successfully created port: 4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Successfully updated port: 4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquired lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-changed-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Refreshing instance network info cache due to event network-changed-4eea14b0-9a05-4eb6-a383-586a5eeb0622. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] Acquiring lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updating instance_info_cache with network_info: [{"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Releasing lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Instance network_info: |[{"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] Acquired lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Refreshing network info cache for port 4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Start _get_guest_xml network_info=[{"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:04:32 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:04:32 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T12:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-768440337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-768440337',id=21,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwvNK99UVRoZeGKk1C2aKDber+NGXwjSb1OF7CVugl+yUKmkGvJI0M5s8sT36aK2k1pNTrMWaY3J39RsxSA0phyvF4PsH3ppSI9HKHL4P2z4EBsY+MbMNsbgNVmcGY86Q==',key_name='tempest-keypair-1300651092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1020d6403b140d7bd28467afcabf8ae',ramdisk_id='',reservation_id='r-fc4zikbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1431365023',owner_user_name='tempest-TaggedAttachmentsTest-1431365023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:04:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6bb5d52609d47e38856a32e3b847bc6',uuid=8f409eb4-2ec5-4481-9cef-5524ec2ae58b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converting VIF {"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:28,bridge_name='br-int',has_traffic_filtering=True,id=4eea14b0-9a05-4eb6-a383-586a5eeb0622,network=Network(e6d019aa-3803-406f-ae9f-ef1909499d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eea14b0-9a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.objects.instance [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:04:32 user nova-compute[71330]:   <uuid>8f409eb4-2ec5-4481-9cef-5524ec2ae58b</uuid>
Apr 14 12:04:32 user nova-compute[71330]:   <name>instance-00000015</name>
Apr 14 12:04:32 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:04:32 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:04:32 user nova-compute[71330]:   <metadata>
Apr 14 12:04:32 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:04:32 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:04:32 user nova-compute[71330]:       <nova:name>tempest-device-tagging-server-768440337</nova:name>
Apr 14 12:04:32 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:04:32</nova:creationTime>
Apr 14 12:04:32 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:04:32 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:04:32 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:04:32 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:04:32 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:04:32 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:04:32 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:04:32 user nova-compute[71330]:       <nova:owner>
Apr 14 12:04:32 user nova-compute[71330]:         <nova:user uuid="e6bb5d52609d47e38856a32e3b847bc6">tempest-TaggedAttachmentsTest-1431365023-project-member</nova:user>
Apr 14 12:04:32 user nova-compute[71330]:         <nova:project uuid="a1020d6403b140d7bd28467afcabf8ae">tempest-TaggedAttachmentsTest-1431365023</nova:project>
Apr 14 12:04:32 user nova-compute[71330]:       </nova:owner>
Apr 14 12:04:32 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:04:32 user nova-compute[71330]:       <nova:ports>
Apr 14 12:04:32 user nova-compute[71330]:         <nova:port uuid="4eea14b0-9a05-4eb6-a383-586a5eeb0622">
Apr 14 12:04:32 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 12:04:32 user nova-compute[71330]:         </nova:port>
Apr 14 12:04:32 user nova-compute[71330]:       </nova:ports>
Apr 14 12:04:32 user nova-compute[71330]:     </nova:instance>
Apr 14 12:04:32 user nova-compute[71330]:   </metadata>
Apr 14 12:04:32 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:04:32 user nova-compute[71330]:     <system>
Apr 14 12:04:32 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:04:32 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:04:32 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:04:32 user nova-compute[71330]:       <entry name="serial">8f409eb4-2ec5-4481-9cef-5524ec2ae58b</entry>
Apr 14 12:04:32 user nova-compute[71330]:       <entry name="uuid">8f409eb4-2ec5-4481-9cef-5524ec2ae58b</entry>
Apr 14 12:04:32 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:04:32 user nova-compute[71330]:     </system>
Apr 14 12:04:32 user nova-compute[71330]:   </sysinfo>
Apr 14 12:04:32 user nova-compute[71330]:   <os>
Apr 14 12:04:32 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:04:32 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:04:32 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:04:32 user nova-compute[71330]:   </os>
Apr 14 12:04:32 user nova-compute[71330]:   <features>
Apr 14 12:04:32 user nova-compute[71330]:     <acpi/>
Apr 14 12:04:32 user nova-compute[71330]:     <apic/>
Apr 14 12:04:32 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:04:32 user nova-compute[71330]:   </features>
Apr 14 12:04:32 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:04:32 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:04:32 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:04:32 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:04:32 user nova-compute[71330]:   </clock>
Apr 14 12:04:32 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:04:32 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:04:32 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:04:32 user nova-compute[71330]:   </cpu>
Apr 14 12:04:32 user nova-compute[71330]:   <devices>
Apr 14 12:04:32 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:04:32 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:04:32 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk"/>
Apr 14 12:04:32 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:04:32 user nova-compute[71330]:     </disk>
Apr 14 12:04:32 user nova-compute[71330]:     <disk type="file" device="cdrom">
Apr 14 12:04:32 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 12:04:32 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk.config"/>
Apr 14 12:04:32 user nova-compute[71330]:       <target dev="hda" bus="ide"/>
Apr 14 12:04:32 user nova-compute[71330]:     </disk>
Apr 14 12:04:32 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:04:32 user nova-compute[71330]:       <mac address="fa:16:3e:cb:97:28"/>
Apr 14 12:04:32 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:04:32 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:04:32 user nova-compute[71330]:       <target dev="tap4eea14b0-9a"/>
Apr 14 12:04:32 user nova-compute[71330]:     </interface>
Apr 14 12:04:32 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:04:32 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/console.log" append="off"/>
Apr 14 12:04:32 user nova-compute[71330]:     </serial>
Apr 14 12:04:32 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:04:32 user nova-compute[71330]:     <video>
Apr 14 12:04:32 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:04:32 user nova-compute[71330]:     </video>
Apr 14 12:04:32 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:04:32 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:04:32 user nova-compute[71330]:     </rng>
Apr 14 12:04:32 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:04:32 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:04:32 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:04:32 user nova-compute[71330]:     </memballoon>
Apr 14 12:04:32 user nova-compute[71330]:   </devices>
Apr 14 12:04:32 user nova-compute[71330]: </domain>
Apr 14 12:04:32 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T12:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-768440337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-768440337',id=21,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwvNK99UVRoZeGKk1C2aKDber+NGXwjSb1OF7CVugl+yUKmkGvJI0M5s8sT36aK2k1pNTrMWaY3J39RsxSA0phyvF4PsH3ppSI9HKHL4P2z4EBsY+MbMNsbgNVmcGY86Q==',key_name='tempest-keypair-1300651092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1020d6403b140d7bd28467afcabf8ae',ramdisk_id='',reservation_id='r-fc4zikbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1431365023',owner_user_name='tempest-TaggedAttachmentsTest-1431365023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:04:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6bb5d52609d47e38856a32e3b847bc6',uuid=8f409eb4-2ec5-4481-9cef-5524ec2ae58b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converting VIF {"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:28,bridge_name='br-int',has_traffic_filtering=True,id=4eea14b0-9a05-4eb6-a383-586a5eeb0622,network=Network(e6d019aa-3803-406f-ae9f-ef1909499d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eea14b0-9a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG os_vif [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:28,bridge_name='br-int',has_traffic_filtering=True,id=4eea14b0-9a05-4eb6-a383-586a5eeb0622,network=Network(e6d019aa-3803-406f-ae9f-ef1909499d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eea14b0-9a') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4eea14b0-9a, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4eea14b0-9a, col_values=(('external_ids', {'iface-id': '4eea14b0-9a05-4eb6-a383-586a5eeb0622', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:97:28', 'vm-uuid': '8f409eb4-2ec5-4481-9cef-5524ec2ae58b'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:32 user nova-compute[71330]: INFO os_vif [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:28,bridge_name='br-int',has_traffic_filtering=True,id=4eea14b0-9a05-4eb6-a383-586a5eeb0622,network=Network(e6d019aa-3803-406f-ae9f-ef1909499d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eea14b0-9a')
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] No BDM found with device name hda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] No VIF found with MAC fa:16:3e:cb:97:28, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:04:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Using config drive
Apr 14 12:04:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Creating config drive at /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk.config
Apr 14 12:04:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp93v8lrz {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp93v8lrz" returned: 0 in 0.085s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updated VIF entry in instance network info cache for port 4eea14b0-9a05-4eb6-a383-586a5eeb0622. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:04:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updating instance_info_cache with network_info: [{"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:04:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] Releasing lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:34 user nova-compute[71330]: INFO nova.compute.manager [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Unrescuing
Apr 14 12:04:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquired lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG nova.network.neutron [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-plugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] No waiting events found dispatching network-vif-plugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:34 user nova-compute[71330]: WARNING nova.compute.manager [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received unexpected event network-vif-plugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance with vm_state building and task_state spawning.
Apr 14 12:04:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:35 user nova-compute[71330]: DEBUG nova.network.neutron [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updating instance_info_cache with network_info: [{"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:04:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Releasing lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:04:35 user nova-compute[71330]: DEBUG nova.objects.instance [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'flavor' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-unplugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-unplugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:36 user nova-compute[71330]: WARNING nova.compute.manager [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-unplugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:04:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Instance destroyed successfully.
Apr 14 12:04:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-plugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] No waiting events found dispatching network-vif-plugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:36 user nova-compute[71330]: WARNING nova.compute.manager [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received unexpected event network-vif-plugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance with vm_state building and task_state spawning.
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473862.3760679, 80b9c47d-7dc8-4bbe-b961-41921a457d98 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:04:37 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] VM Stopped (Lifecycle Event)
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-384c23c4-be6f-4f55-aebf-e5e57e3ff9a3 None None] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473877.590394, 8f409eb4-2ec5-4481-9cef-5524ec2ae58b => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:04:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] VM Resumed (Lifecycle Event)
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:04:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Instance spawned successfully.
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:04:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473877.594316, 8f409eb4-2ec5-4481-9cef-5524ec2ae58b => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:04:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] VM Started (Lifecycle Event)
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:04:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:04:37 user nova-compute[71330]: INFO nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Took 7.61 seconds to spawn the instance on the hypervisor.
Apr 14 12:04:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:37 user nova-compute[71330]: INFO nova.compute.manager [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Took 8.63 seconds to build instance.
Apr 14 12:04:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.761s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:38 user nova-compute[71330]: WARNING nova.compute.manager [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:04:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:40 user nova-compute[71330]: WARNING nova.compute.manager [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:40 user nova-compute[71330]: WARNING nova.compute.manager [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for fcd74f51-099e-4c19-af7d-912f622fb153 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473880.6667383, fcd74f51-099e-4c19-af7d-912f622fb153 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:04:40 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] VM Resumed (Lifecycle Event)
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.compute.manager [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:04:40 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473880.6687095, fcd74f51-099e-4c19-af7d-912f622fb153 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:04:40 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] VM Started (Lifecycle Event)
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:04:40 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:04:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:04:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:04:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:04:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:04:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updating instance_info_cache with network_info: [{"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:04:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:04:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:04:45 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:45 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:45 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:04:45 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:49 user nova-compute[71330]: INFO nova.compute.manager [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Detaching volume 2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7
Apr 14 12:04:49 user nova-compute[71330]: INFO nova.virt.block_device [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Attempting to driver detach volume 2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 from mountpoint /dev/vdb
Apr 14 12:04:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Attempting to detach device vdb from instance 93d16198-833e-4412-99ee-637bcf13624d from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:04:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:04:49 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:04:49 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:04:49 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:04:49 user nova-compute[71330]:   <serial>2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7</serial>
Apr 14 12:04:49 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:04:49 user nova-compute[71330]: </disk>
Apr 14 12:04:49 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:04:49 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Successfully detached device vdb from instance 93d16198-833e-4412-99ee-637bcf13624d from the persistent domain config.
Apr 14 12:04:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93d16198-833e-4412-99ee-637bcf13624d from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:04:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:04:49 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:04:49 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:04:49 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:04:49 user nova-compute[71330]:   <serial>2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7</serial>
Apr 14 12:04:49 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:04:49 user nova-compute[71330]: </disk>
Apr 14 12:04:49 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:04:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473890.0682912, 93d16198-833e-4412-99ee-637bcf13624d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93d16198-833e-4412-99ee-637bcf13624d {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:04:50 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Successfully detached device vdb from instance 93d16198-833e-4412-99ee-637bcf13624d from the live domain config.
Apr 14 12:04:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZlxsoIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:04:50 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ac1e3d-ef23-4862-80ad-9b627204189a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:04:50 user nova-compute[71330]: No targets found.
Apr 14 12:04:50 user nova-compute[71330]: iSNS:
Apr 14 12:04:50 user nova-compute[71330]: No targets found.
Apr 14 12:04:50 user nova-compute[71330]: STATIC:
Apr 14 12:04:50 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:04:50 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:04:50 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:04:50 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7
Apr 14 12:04:50 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:04:50 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:04:50 user nova-compute[71330]: FIRMWARE:
Apr 14 12:04:50 user nova-compute[71330]: No targets found.
Apr 14 12:04:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:04:50 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:04:50 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a26372-6d30-4b61-8492-ad2239d52d00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7ced17-b97d-4649-84b5-4523cfd83bad]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:50 user nova-compute[71330]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 (non-flash)
Apr 14 12:04:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:50 user nova-compute[71330]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 (non-flash)
Apr 14 12:04:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c12b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4bb655-4be2-436e-90dc-de93c2c51db9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[47168374-75f6-4a14-925b-3c697ce5d121]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c710dfc-2c48-4391-a9af-3d7ab5e7d27a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae9949b-6ca4-4630-803a-07892874969c]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9052fa-736c-425f-a599-bbf361b05c0d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a6b5fc-e228-4ec6-82ce-301c4ee8e22d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7, portal: 172.16.0.220,3260]
Apr 14 12:04:50 user nova-compute[71330]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7, portal: 172.16.0.220,3260] successful.
Apr 14 12:04:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc98cc7-5c46-4f18-99a3-83aec788b9e1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] <== disconnect_volume: return (304ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG nova.objects.instance [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'flavor' on Instance uuid 93d16198-833e-4412-99ee-637bcf13624d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.846s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.663s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:51 user nova-compute[71330]: INFO nova.compute.manager [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Terminating instance
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received event network-vif-unplugged-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] No waiting events found dispatching network-vif-unplugged-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received event network-vif-unplugged-f31873b1-ecc8-435f-b33b-75410f24a124 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Instance destroyed successfully.
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.objects.instance [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'resources' on Instance uuid 93d16198-833e-4412-99ee-637bcf13624d {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1278423122',display_name='tempest-VolumesSnapshotTestJSON-instance-1278423122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1278423122',id=18,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:02:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae5ac6388692423b9bf23bf6be0cb06d',ramdisk_id='',reservation_id='r-t92ykmh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1634639087',owner_user_name='tempest-VolumesSnapshotTestJSON-1634639087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:02:38Z,user_data=None,user_id='61adadbd79ef493889ef3dcb63f63fd8',uuid=93d16198-833e-4412-99ee-637bcf13624d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converting VIF {"id": "f31873b1-ecc8-435f-b33b-75410f24a124", "address": "fa:16:3e:35:c3:1e", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31873b1-ec", "ovs_interfaceid": "f31873b1-ecc8-435f-b33b-75410f24a124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:c3:1e,bridge_name='br-int',has_traffic_filtering=True,id=f31873b1-ecc8-435f-b33b-75410f24a124,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31873b1-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_vif [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:c3:1e,bridge_name='br-int',has_traffic_filtering=True,id=f31873b1-ecc8-435f-b33b-75410f24a124,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31873b1-ec') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf31873b1-ec, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:04:52 user nova-compute[71330]: INFO os_vif [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:c3:1e,bridge_name='br-int',has_traffic_filtering=True,id=f31873b1-ecc8-435f-b33b-75410f24a124,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31873b1-ec')
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZlxsoIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:04:52 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f00873f-f92d-451f-ac58-12a7b59a1b6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:04:52 user nova-compute[71330]: No targets found.
Apr 14 12:04:52 user nova-compute[71330]: iSNS:
Apr 14 12:04:52 user nova-compute[71330]: No targets found.
Apr 14 12:04:52 user nova-compute[71330]: STATIC:
Apr 14 12:04:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:04:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:04:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:04:52 user nova-compute[71330]: FIRMWARE:
Apr 14 12:04:52 user nova-compute[71330]: No targets found.
Apr 14 12:04:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:04:52 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:04:52 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[279c7fc2-0f0d-4ae2-a53a-32894c79b0f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6a7642-7dba-490b-abb8-ee850dd8ee6a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:04:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495c3f1ea0>, {}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Disconnecting from: [] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] <== disconnect_volume: return (85ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:04:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Deleting instance files /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d_del
Apr 14 12:04:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Deletion of /opt/stack/data/nova/instances/93d16198-833e-4412-99ee-637bcf13624d_del complete
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: INFO nova.compute.manager [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 93d16198-833e-4412-99ee-637bcf13624d] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid '93d16198-833e-4412-99ee-637bcf13624d' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid '93d16198-833e-4412-99ee-637bcf13624d' (instance-00000012)
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:04:52 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Took 0.47 seconds to deallocate network for instance.
Apr 14 12:04:52 user nova-compute[71330]: WARNING nova.volume.cinder [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Attachment fe8fbf77-d525-4d77-b51f-372539edc203 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fe8fbf77-d525-4d77-b51f-372539edc203. (HTTP 404) (Request-ID: req-d73dd3e3-59d2-40cd-b0d1-df5b883f6de4)
Apr 14 12:04:52 user nova-compute[71330]: INFO nova.compute.manager [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:04:53 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Deleted allocations for instance 93d16198-833e-4412-99ee-637bcf13624d
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "93d16198-833e-4412-99ee-637bcf13624d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received event network-vif-plugged-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] Acquiring lock "93d16198-833e-4412-99ee-637bcf13624d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] Lock "93d16198-833e-4412-99ee-637bcf13624d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] No waiting events found dispatching network-vif-plugged-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:04:53 user nova-compute[71330]: WARNING nova.compute.manager [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received unexpected event network-vif-plugged-f31873b1-ecc8-435f-b33b-75410f24a124 for instance with vm_state deleted and task_state None.
Apr 14 12:04:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Received event network-vif-deleted-f31873b1-ecc8-435f-b33b-75410f24a124 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:04:53 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:04:53 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:04:53 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7653MB free_disk=26.260204315185547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:04:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:04:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:04:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:07 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473892.0790474, 93d16198-833e-4412-99ee-637bcf13624d => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:05:07 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 93d16198-833e-4412-99ee-637bcf13624d] VM Stopped (Lifecycle Event)
Apr 14 12:05:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9c95960d-92a5-40de-8466-ddf83032abe0 None None] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:09 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'flavor' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:10 user nova-compute[71330]: INFO nova.compute.manager [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attaching volume c1aad796-79f6-420f-99ba-c2d1212ece0c to /dev/vdb
Apr 14 12:05:10 user nova-compute[71330]: DEBUG os_brick.utils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0c5872-caca-4034-ace9-d442303dc2c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[da608c89-9199-4e31-a097-8b3b7ba07240]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfb4155-281a-46d2-9d97-d434f01831b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c93533-5415-4019-9703-378d4153ec6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:05:10 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:05:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b461d4-cc1c-4a14-8190-b6164abbaba2]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG os_brick.utils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:05:10 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating existing volume attachment record: 9366a977-7599-493d-94c1-44b7f86e5636 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:05:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:05:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:05:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:05:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:05:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:13 user nova-compute[71330]: DEBUG nova.compute.manager [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:13 user nova-compute[71330]: INFO nova.compute.manager [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] instance snapshotting
Apr 14 12:05:14 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Beginning live snapshot process
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json -f qcow2 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json -f qcow2 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json -f qcow2" returned: 0 in 0.129s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmr3omk9d/57b9899c4b87404e8570c7f4f00ac775.delta 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmr3omk9d/57b9899c4b87404e8570c7f4f00ac775.delta 1073741824" returned: 0 in 0.048s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 12:05:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOhsBnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:05:14 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:05:14 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:05:14 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a19fd-941e-4ee4-a8c5-2dd655ab7fda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:05:14 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5810f41-22d6-4e5c-8743-67cf68e0e03c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c] added
Apr 14 12:05:14 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab35e4f0-7569-409a-8c10-b114715b8ab6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[44732233-7742-49ed-8480-1b50df94aa24]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfOhsBnD {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfOhsBnD" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[495f8cbd-42d5-421d-9b54-15763d30d474]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pfOhsBnD'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea870890-f68f-48a2-af00-be6709503779]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[84728562-768b-420c-ab40-5e3ffbf852fe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:14 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:14 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:05:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b365ca5f-4139-485a-80bc-f76f6efd4972]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260]
Apr 14 12:05:15 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260] successful.
Apr 14 12:05:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2d3d0a-b0c2-4dfa-b0a4-daddb5b796f1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7761d406-5119-4626-86cd-fe1d243538d2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:15 user nova-compute[71330]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:15 user nova-compute[71330]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e11982-98e9-4111-9fab-f81f0537aa06]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOhsBnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 12:05:15 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 12:05:15 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:05:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmr3omk9d/57b9899c4b87404e8570c7f4f00ac775.delta /opt/stack/data/nova/instances/snapshots/tmpmr3omk9d/57b9899c4b87404e8570c7f4f00ac775 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:05:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26165386632636264', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:05:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165386632636264', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:05:16 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'flavor' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:05:16 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:05:16 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:05:16 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:05:16 user nova-compute[71330]:   <serial>c1aad796-79f6-420f-99ba-c2d1212ece0c</serial>
Apr 14 12:05:16 user nova-compute[71330]: </disk>
Apr 14 12:05:16 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:05:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmr3omk9d/57b9899c4b87404e8570c7f4f00ac775.delta /opt/stack/data/nova/instances/snapshots/tmpmr3omk9d/57b9899c4b87404e8570c7f4f00ac775" returned: 0 in 0.364s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:16 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Snapshot extracted, beginning image upload
Apr 14 12:05:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:05:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:05:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No VIF found with MAC fa:16:3e:e5:db:94, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:05:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.715s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:18 user nova-compute[71330]: INFO nova.compute.manager [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Rebuilding instance
Apr 14 12:05:18 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'trusted_certs' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'pci_requests' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'pci_devices' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'resources' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'migration_context' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71330) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Snapshot image upload complete
Apr 14 12:05:18 user nova-compute[71330]: INFO nova.compute.manager [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Took 4.73 seconds to snapshot the instance on the hypervisor.
Apr 14 12:05:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:18 user nova-compute[71330]: WARNING nova.compute.manager [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state rebuilding.
Apr 14 12:05:19 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance destroyed successfully.
Apr 14 12:05:19 user nova-compute[71330]: INFO nova.compute.manager [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Detaching volume c1aad796-79f6-420f-99ba-c2d1212ece0c
Apr 14 12:05:19 user nova-compute[71330]: INFO nova.virt.block_device [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attempting to driver detach volume c1aad796-79f6-420f-99ba-c2d1212ece0c from mountpoint /dev/vdb
Apr 14 12:05:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Attempting to detach device vdb from instance 11e4aa91-7c03-46cc-8610-78f18bbd089f from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:05:19 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:05:19 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:05:19 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:05:19 user nova-compute[71330]:   <serial>c1aad796-79f6-420f-99ba-c2d1212ece0c</serial>
Apr 14 12:05:19 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:05:19 user nova-compute[71330]: </disk>
Apr 14 12:05:19 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:05:19 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully detached device vdb from instance 11e4aa91-7c03-46cc-8610-78f18bbd089f from the persistent domain config.
Apr 14 12:05:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOhsBnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:05:19 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe884ac8-9dc0-422c-bfd3-35c19b3fbb40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:05:19 user nova-compute[71330]: No targets found.
Apr 14 12:05:19 user nova-compute[71330]: iSNS:
Apr 14 12:05:19 user nova-compute[71330]: No targets found.
Apr 14 12:05:19 user nova-compute[71330]: STATIC:
Apr 14 12:05:19 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c
Apr 14 12:05:19 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:05:19 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:05:19 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:05:19 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:05:19 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:05:19 user nova-compute[71330]: FIRMWARE:
Apr 14 12:05:19 user nova-compute[71330]: No targets found.
Apr 14 12:05:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:05:19 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:05:19 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b351fc-980b-4dfa-b3b5-07041e670d98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[841016a9-4685-47bc-8c60-9f4be4d825bd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:19 user nova-compute[71330]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:19 user nova-compute[71330]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c12a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ef9e73-e736-47bb-a979-5da617bc7f34]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d4f83-9874-453f-9d61-8f16112ef848]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf83be8-7a92-43f8-b6dd-f535eee024a4]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a81b40-a8e0-48cc-8c2b-1d078d0274cd]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffe9223-9222-4f55-af99-6ef960af0783]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e3bd45-0cf0-4b6e-b3a5-c8c200788ac2]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260]
Apr 14 12:05:19 user nova-compute[71330]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260] successful.
Apr 14 12:05:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[365ef20b-9b38-473f-9079-53c334231c48]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== disconnect_volume: return (298ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:05:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:05:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance destroyed successfully.
Apr 14 12:05:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:01:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_vif [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7cd0790-d7, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:05:20 user nova-compute[71330]: INFO os_vif [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7')
Apr 14 12:05:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOhsBnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:05:20 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7456a38-3514-4cf2-bec0-473f788eb24f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:05:20 user nova-compute[71330]: No targets found.
Apr 14 12:05:20 user nova-compute[71330]: iSNS:
Apr 14 12:05:20 user nova-compute[71330]: No targets found.
Apr 14 12:05:20 user nova-compute[71330]: STATIC:
Apr 14 12:05:20 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:05:20 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:05:20 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:05:20 user nova-compute[71330]: FIRMWARE:
Apr 14 12:05:20 user nova-compute[71330]: No targets found.
Apr 14 12:05:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:05:20 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:05:20 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dd189a-5465-4417-874e-8d03ec41c4ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[efca365f-19a8-4ca7-98f6-dfd33974f480]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495412b760>, {}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Disconnecting from: [] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== disconnect_volume: return (72ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:05:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Deleting instance files /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f_del
Apr 14 12:05:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Deletion of /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f_del complete
Apr 14 12:05:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:20 user nova-compute[71330]: WARNING nova.compute.manager [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state rebuilding.
Apr 14 12:05:20 user nova-compute[71330]: INFO nova.virt.block_device [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Booting with volume c1aad796-79f6-420f-99ba-c2d1212ece0c at /dev/vdb
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.utils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bdeaa7-c7b5-4c43-9a8d-b0bffa15984d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6b5873-dd74-4531-902e-b876e6e54bbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0d995d-4300-4d75-8258-069e6039855a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4dc8e7-f932-4576-ab02-5958ac8697eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:05:20 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:05:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d738b850-6266-45b0-96f4-f2037b8f6a10]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG os_brick.utils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:05:20 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating existing volume attachment record: 285fcc43-d6d2-4962-b039-72bd21f0c09c {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:05:24 user nova-compute[71330]: INFO nova.compute.claims [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Claim successful on node user
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:05:24 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.policy [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:05:24 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Creating image(s)
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "/opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "/opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "/opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "7ca110ff5bf6ae8d76397b8f87c283136829a425" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "7ca110ff5bf6ae8d76397b8f87c283136829a425" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Successfully created port: 4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425.part --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.virt.images [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 98eae243-e785-4a84-b3a6-939da193871d was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425.part /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:05:26 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Creating image(s)
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425.part /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425.converted" returned: 0 in 0.431s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.179s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk 1073741824" returned: 0 in 0.054s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425.converted --force-share --output=json" returned: 0 in 0.162s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "7ca110ff5bf6ae8d76397b8f87c283136829a425" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.891s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:05:26 user nova-compute[71330]: INFO nova.compute.claims [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Claim successful on node user
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Successfully updated port: 4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-changed-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Refreshing instance network info cache due to event network-changed-4f8abc87-2a83-454a-9a91-eebcf782364e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] Acquiring lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] Acquired lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.network.neutron [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Refreshing network info cache for port 4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425 --force-share --output=json" returned: 0 in 0.163s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "7ca110ff5bf6ae8d76397b8f87c283136829a425" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "7ca110ff5bf6ae8d76397b8f87c283136829a425" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Cannot resize image /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Ensure instance console log exists: /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Start _get_guest_xml network_info=[{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '285fcc43-d6d2-4962-b039-72bd21f0c09c', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOhsBnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11e4aa91-7c03-46cc-8610-78f18bbd089f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1aad796-79f6-420f-99ba-c2d1212ece0c', 'serial': 'c1aad796-79f6-420f-99ba-c2d1212ece0c'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:05:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 12:05:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.neutron [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOhsBnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:05:27 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:05:27 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:05:27 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425 --force-share --output=json" returned: 0 in 0.162s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425,backing_fmt=raw /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31bf30a-3bab-4145-a9fd-2816a17ce2cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:05:27 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425,backing_fmt=raw /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk 1073741824" returned: 0 in 0.055s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "7ca110ff5bf6ae8d76397b8f87c283136829a425" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b7a494-4593-4bb6-8060-9d461e91f192]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c] added
Apr 14 12:05:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df263ac-491e-432a-bafa-16b8efc9e058]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.neutron [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[530b8cac-9905-4a6f-a8eb-7deeaf5bd563]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfOhsBnD {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] Releasing lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquired lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfOhsBnD" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d025eff9-fa62-496b-82ee-7908235d4a7f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pfOhsBnD'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425 --force-share --output=json" returned: 0 in 0.157s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'migration_context' on Instance uuid b79d8978-9bc5-4a22-98cf-025f949dc1bc {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b15509a-ce76-4c7c-a25d-b2c362c8bccf]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Ensure instance console log exists: /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77c4ed7-fb53-41b4-bcef-087e8b135887]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5333b155-89d1-4977-83d3-e0212bff8aa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260]
Apr 14 12:05:27 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260] successful.
Apr 14 12:05:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[99342da9-2f5c-4506-8355-fefaff0a4d79]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc6e1b8-7bbd-44e6-9828-06fbf373d58c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:27 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:27 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd92623d-2a01-4493-b007-132e42550523]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOhsBnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:05:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:05:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Creating image(s)
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.policy [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Updating instance_info_cache with network_info: [{"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Releasing lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Instance network_info: |[{"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Start _get_guest_xml network_info=[{"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1ab109f33ebb6acccbb0792efee8eda5',container_format='bare',created_at=2023-04-14T12:05:14Z,direct_url=<?>,disk_format='qcow2',id=98eae243-e785-4a84-b3a6-939da193871d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-438143633',owner='cfb2ac7942e1473f88b05de5aa79a3ee',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T12:05:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '98eae243-e785-4a84-b3a6-939da193871d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:05:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:05:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1ab109f33ebb6acccbb0792efee8eda5',container_format='bare',created_at=2023-04-14T12:05:14Z,direct_url=<?>,disk_format='qcow2',id=98eae243-e785-4a84-b3a6-939da193871d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-438143633',owner='cfb2ac7942e1473f88b05de5aa79a3ee',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T12:05:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1674782637',display_name='tempest-TestStampPattern-server-1674782637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1674782637',id=22,image_ref='98eae243-e785-4a84-b3a6-939da193871d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcWumXfNSjLDovtKNaUkPPvNJyQGmlmWEq5lmR1ljchHoI3F3BUNa7dKibvc69DYc5cYCD1AWmxfaa3wcxsCbua+WlZRoR5F/ExK2Ac04hcBu8nxWqQ13C+9/nYhnqwIg==',key_name='tempest-TestStampPattern-1794429979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfb2ac7942e1473f88b05de5aa79a3ee',ramdisk_id='',reservation_id='r-o7qb5gtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ba2689ad-6a47-45c2-b5db-bec9e5a152ac',image_min_disk='1',image_min_ram='0',image_owner_id='cfb2ac7942e1473f88b05de5aa79a3ee',image_owner_project_name='tempest-TestStampPattern-1032317746',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1032317746-project-member',image_user_id='e2b8b516910f41ffbb8bbf5f9e3c2ec8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1032317746',owner_user_name='tempest-TestStampPattern-1032317746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:25Z,user_data=None,user_id='e2b8b516910f41ffbb8bbf5f9e3c2ec8',uuid=b79d8978-9bc5-4a22-98cf-025f949dc1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converting VIF {"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:82:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f8abc87-2a83-454a-9a91-eebcf782364e,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8abc87-2a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'pci_devices' on Instance uuid b79d8978-9bc5-4a22-98cf-025f949dc1bc {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:05:27 user nova-compute[71330]:   <uuid>b79d8978-9bc5-4a22-98cf-025f949dc1bc</uuid>
Apr 14 12:05:27 user nova-compute[71330]:   <name>instance-00000016</name>
Apr 14 12:05:27 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:05:27 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:05:27 user nova-compute[71330]:   <metadata>
Apr 14 12:05:27 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:05:27 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:05:27 user nova-compute[71330]:       <nova:name>tempest-TestStampPattern-server-1674782637</nova:name>
Apr 14 12:05:27 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:05:27</nova:creationTime>
Apr 14 12:05:27 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:05:27 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:05:27 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:05:27 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:05:27 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:05:27 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:05:27 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:05:27 user nova-compute[71330]:       <nova:owner>
Apr 14 12:05:27 user nova-compute[71330]:         <nova:user uuid="e2b8b516910f41ffbb8bbf5f9e3c2ec8">tempest-TestStampPattern-1032317746-project-member</nova:user>
Apr 14 12:05:27 user nova-compute[71330]:         <nova:project uuid="cfb2ac7942e1473f88b05de5aa79a3ee">tempest-TestStampPattern-1032317746</nova:project>
Apr 14 12:05:27 user nova-compute[71330]:       </nova:owner>
Apr 14 12:05:27 user nova-compute[71330]:       <nova:root type="image" uuid="98eae243-e785-4a84-b3a6-939da193871d"/>
Apr 14 12:05:27 user nova-compute[71330]:       <nova:ports>
Apr 14 12:05:27 user nova-compute[71330]:         <nova:port uuid="4f8abc87-2a83-454a-9a91-eebcf782364e">
Apr 14 12:05:27 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 12:05:27 user nova-compute[71330]:         </nova:port>
Apr 14 12:05:27 user nova-compute[71330]:       </nova:ports>
Apr 14 12:05:27 user nova-compute[71330]:     </nova:instance>
Apr 14 12:05:27 user nova-compute[71330]:   </metadata>
Apr 14 12:05:27 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:05:27 user nova-compute[71330]:     <system>
Apr 14 12:05:27 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:05:27 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:05:27 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:05:27 user nova-compute[71330]:       <entry name="serial">b79d8978-9bc5-4a22-98cf-025f949dc1bc</entry>
Apr 14 12:05:27 user nova-compute[71330]:       <entry name="uuid">b79d8978-9bc5-4a22-98cf-025f949dc1bc</entry>
Apr 14 12:05:27 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:05:27 user nova-compute[71330]:     </system>
Apr 14 12:05:27 user nova-compute[71330]:   </sysinfo>
Apr 14 12:05:27 user nova-compute[71330]:   <os>
Apr 14 12:05:27 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:05:27 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:05:27 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:05:27 user nova-compute[71330]:   </os>
Apr 14 12:05:27 user nova-compute[71330]:   <features>
Apr 14 12:05:27 user nova-compute[71330]:     <acpi/>
Apr 14 12:05:27 user nova-compute[71330]:     <apic/>
Apr 14 12:05:27 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:05:27 user nova-compute[71330]:   </features>
Apr 14 12:05:27 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:05:27 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:05:27 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:05:27 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:05:27 user nova-compute[71330]:   </clock>
Apr 14 12:05:27 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:05:27 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:05:27 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:05:27 user nova-compute[71330]:   </cpu>
Apr 14 12:05:27 user nova-compute[71330]:   <devices>
Apr 14 12:05:27 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:05:27 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:05:27 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk"/>
Apr 14 12:05:27 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:05:27 user nova-compute[71330]:     </disk>
Apr 14 12:05:27 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:05:27 user nova-compute[71330]:       <mac address="fa:16:3e:f7:82:d8"/>
Apr 14 12:05:27 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:05:27 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:05:27 user nova-compute[71330]:       <target dev="tap4f8abc87-2a"/>
Apr 14 12:05:27 user nova-compute[71330]:     </interface>
Apr 14 12:05:27 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:05:27 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/console.log" append="off"/>
Apr 14 12:05:27 user nova-compute[71330]:     </serial>
Apr 14 12:05:27 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:05:27 user nova-compute[71330]:     <video>
Apr 14 12:05:27 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:05:27 user nova-compute[71330]:     </video>
Apr 14 12:05:27 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:05:27 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:05:27 user nova-compute[71330]:     </rng>
Apr 14 12:05:27 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:05:27 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:05:27 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:05:27 user nova-compute[71330]:     </memballoon>
Apr 14 12:05:27 user nova-compute[71330]:   </devices>
Apr 14 12:05:27 user nova-compute[71330]: </domain>
Apr 14 12:05:27 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1674782637',display_name='tempest-TestStampPattern-server-1674782637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1674782637',id=22,image_ref='98eae243-e785-4a84-b3a6-939da193871d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcWumXfNSjLDovtKNaUkPPvNJyQGmlmWEq5lmR1ljchHoI3F3BUNa7dKibvc69DYc5cYCD1AWmxfaa3wcxsCbua+WlZRoR5F/ExK2Ac04hcBu8nxWqQ13C+9/nYhnqwIg==',key_name='tempest-TestStampPattern-1794429979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfb2ac7942e1473f88b05de5aa79a3ee',ramdisk_id='',reservation_id='r-o7qb5gtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ba2689ad-6a47-45c2-b5db-bec9e5a152ac',image_min_disk='1',image_min_ram='0',image_owner_id='cfb2ac7942e1473f88b05de5aa79a3ee',image_owner_project_name='tempest-TestStampPattern-1032317746',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1032317746-project-member',image_user_id='e2b8b516910f41ffbb8bbf5f9e3c2ec8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1032317746',owner_user_name='tempest-TestStampPattern-1032317746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:25Z,user_data=None,user_id='e2b8b516910f41ffbb8bbf5f9e3c2ec8',uuid=b79d8978-9bc5-4a22-98cf-025f949dc1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converting VIF {"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:82:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f8abc87-2a83-454a-9a91-eebcf782364e,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8abc87-2a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG os_vif [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:82:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f8abc87-2a83-454a-9a91-eebcf782364e,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8abc87-2a') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f8abc87-2a, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f8abc87-2a, col_values=(('external_ids', {'iface-id': '4f8abc87-2a83-454a-9a91-eebcf782364e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:82:d8', 'vm-uuid': 'b79d8978-9bc5-4a22-98cf-025f949dc1bc'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:27 user nova-compute[71330]: INFO os_vif [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:82:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f8abc87-2a83-454a-9a91-eebcf782364e,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8abc87-2a')
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No VIF found with MAC fa:16:3e:f7:82:d8, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk 1073741824" returned: 0 in 0.053s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Cannot resize image /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.objects.instance [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'migration_context' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Ensure instance console log exists: /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Successfully created port: 3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26165386632636264', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165386632636264', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:01:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:05:28 user nova-compute[71330]:   <uuid>11e4aa91-7c03-46cc-8610-78f18bbd089f</uuid>
Apr 14 12:05:28 user nova-compute[71330]:   <name>instance-0000000f</name>
Apr 14 12:05:28 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:05:28 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:05:28 user nova-compute[71330]:   <metadata>
Apr 14 12:05:28 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:05:28 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:05:28 user nova-compute[71330]:       <nova:name>tempest-ServerActionsTestJSON-server-451636587</nova:name>
Apr 14 12:05:28 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:05:27</nova:creationTime>
Apr 14 12:05:28 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:05:28 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:05:28 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:05:28 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:05:28 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:05:28 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:05:28 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:05:28 user nova-compute[71330]:       <nova:owner>
Apr 14 12:05:28 user nova-compute[71330]:         <nova:user uuid="7e264a59ff9b42e08095d0ce71e4d627">tempest-ServerActionsTestJSON-1592133549-project-member</nova:user>
Apr 14 12:05:28 user nova-compute[71330]:         <nova:project uuid="3e4ff63247dd4535bcd86acfde76fd34">tempest-ServerActionsTestJSON-1592133549</nova:project>
Apr 14 12:05:28 user nova-compute[71330]:       </nova:owner>
Apr 14 12:05:28 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:05:28 user nova-compute[71330]:       <nova:ports>
Apr 14 12:05:28 user nova-compute[71330]:         <nova:port uuid="d7cd0790-d778-4855-b7ad-c0b5c0258c1b">
Apr 14 12:05:28 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 12:05:28 user nova-compute[71330]:         </nova:port>
Apr 14 12:05:28 user nova-compute[71330]:       </nova:ports>
Apr 14 12:05:28 user nova-compute[71330]:     </nova:instance>
Apr 14 12:05:28 user nova-compute[71330]:   </metadata>
Apr 14 12:05:28 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:05:28 user nova-compute[71330]:     <system>
Apr 14 12:05:28 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:05:28 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:05:28 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:05:28 user nova-compute[71330]:       <entry name="serial">11e4aa91-7c03-46cc-8610-78f18bbd089f</entry>
Apr 14 12:05:28 user nova-compute[71330]:       <entry name="uuid">11e4aa91-7c03-46cc-8610-78f18bbd089f</entry>
Apr 14 12:05:28 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:05:28 user nova-compute[71330]:     </system>
Apr 14 12:05:28 user nova-compute[71330]:   </sysinfo>
Apr 14 12:05:28 user nova-compute[71330]:   <os>
Apr 14 12:05:28 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:05:28 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:05:28 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:05:28 user nova-compute[71330]:   </os>
Apr 14 12:05:28 user nova-compute[71330]:   <features>
Apr 14 12:05:28 user nova-compute[71330]:     <acpi/>
Apr 14 12:05:28 user nova-compute[71330]:     <apic/>
Apr 14 12:05:28 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:05:28 user nova-compute[71330]:   </features>
Apr 14 12:05:28 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:05:28 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:05:28 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:05:28 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:05:28 user nova-compute[71330]:   </clock>
Apr 14 12:05:28 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:05:28 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:05:28 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:05:28 user nova-compute[71330]:   </cpu>
Apr 14 12:05:28 user nova-compute[71330]:   <devices>
Apr 14 12:05:28 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:05:28 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:05:28 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk"/>
Apr 14 12:05:28 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:05:28 user nova-compute[71330]:     </disk>
Apr 14 12:05:28 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:05:28 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:05:28 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 12:05:28 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:05:28 user nova-compute[71330]:       <serial>c1aad796-79f6-420f-99ba-c2d1212ece0c</serial>
Apr 14 12:05:28 user nova-compute[71330]:     </disk>
Apr 14 12:05:28 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:05:28 user nova-compute[71330]:       <mac address="fa:16:3e:e5:db:94"/>
Apr 14 12:05:28 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:05:28 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:05:28 user nova-compute[71330]:       <target dev="tapd7cd0790-d7"/>
Apr 14 12:05:28 user nova-compute[71330]:     </interface>
Apr 14 12:05:28 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:05:28 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/console.log" append="off"/>
Apr 14 12:05:28 user nova-compute[71330]:     </serial>
Apr 14 12:05:28 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:05:28 user nova-compute[71330]:     <video>
Apr 14 12:05:28 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:05:28 user nova-compute[71330]:     </video>
Apr 14 12:05:28 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:05:28 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:05:28 user nova-compute[71330]:     </rng>
Apr 14 12:05:28 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:05:28 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:05:28 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:05:28 user nova-compute[71330]:     </memballoon>
Apr 14 12:05:28 user nova-compute[71330]:   </devices>
Apr 14 12:05:28 user nova-compute[71330]: </domain>
Apr 14 12:05:28 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:01:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG os_vif [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7cd0790-d7, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7cd0790-d7, col_values=(('external_ids', {'iface-id': 'd7cd0790-d778-4855-b7ad-c0b5c0258c1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:db:94', 'vm-uuid': '11e4aa91-7c03-46cc-8610-78f18bbd089f'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:28 user nova-compute[71330]: INFO os_vif [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7')
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:05:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No VIF found with MAC fa:16:3e:e5:db:94, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.network.neutron [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Successfully updated port: 3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquired lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.network.neutron [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-changed-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Refreshing instance network info cache due to event network-changed-3ba9407c-344c-45b8-a483-36e0c0e72ff0. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] Acquiring lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.network.neutron [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.network.neutron [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating instance_info_cache with network_info: [{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Releasing lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Instance network_info: |[{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] Acquired lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.network.neutron [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Refreshing network info cache for port 3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Start _get_guest_xml network_info=[{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:05:29 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:05:29 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1425077184',display_name='tempest-ServerRescueNegativeTestJSON-server-1425077184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1425077184',id=23,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChwBqnED/n2nWrN2SoLSMRhqkE84LnQSbYpaeWVgLfUiXzTqQT/5YeOR1ydLbZ836JaTZWc0GepItYuqZ/dHFeEKlQx8bHxyYpEaXK0Bnde9kYWx5+wzLpg/aD1Yl4K9A==',key_name='tempest-keypair-1239489635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-x76brrrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=4595c0e6-f2af-47ef-b26e-7b1ccb58aa47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c2:00,bridge_name='br-int',has_traffic_filtering=True,id=3ba9407c-344c-45b8-a483-36e0c0e72ff0,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9407c-34') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.objects.instance [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'pci_devices' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:05:29 user nova-compute[71330]:   <uuid>4595c0e6-f2af-47ef-b26e-7b1ccb58aa47</uuid>
Apr 14 12:05:29 user nova-compute[71330]:   <name>instance-00000017</name>
Apr 14 12:05:29 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:05:29 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:05:29 user nova-compute[71330]:   <metadata>
Apr 14 12:05:29 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:05:29 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:05:29 user nova-compute[71330]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1425077184</nova:name>
Apr 14 12:05:29 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:05:29</nova:creationTime>
Apr 14 12:05:29 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:05:29 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:05:29 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:05:29 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:05:29 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:05:29 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:05:29 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:05:29 user nova-compute[71330]:       <nova:owner>
Apr 14 12:05:29 user nova-compute[71330]:         <nova:user uuid="263c47076ee94cfaaa34eff928a36fdd">tempest-ServerRescueNegativeTestJSON-896417797-project-member</nova:user>
Apr 14 12:05:29 user nova-compute[71330]:         <nova:project uuid="f042abdcef8f41488e8f4624c2f4970b">tempest-ServerRescueNegativeTestJSON-896417797</nova:project>
Apr 14 12:05:29 user nova-compute[71330]:       </nova:owner>
Apr 14 12:05:29 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:05:29 user nova-compute[71330]:       <nova:ports>
Apr 14 12:05:29 user nova-compute[71330]:         <nova:port uuid="3ba9407c-344c-45b8-a483-36e0c0e72ff0">
Apr 14 12:05:29 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 12:05:29 user nova-compute[71330]:         </nova:port>
Apr 14 12:05:29 user nova-compute[71330]:       </nova:ports>
Apr 14 12:05:29 user nova-compute[71330]:     </nova:instance>
Apr 14 12:05:29 user nova-compute[71330]:   </metadata>
Apr 14 12:05:29 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:05:29 user nova-compute[71330]:     <system>
Apr 14 12:05:29 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:05:29 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:05:29 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:05:29 user nova-compute[71330]:       <entry name="serial">4595c0e6-f2af-47ef-b26e-7b1ccb58aa47</entry>
Apr 14 12:05:29 user nova-compute[71330]:       <entry name="uuid">4595c0e6-f2af-47ef-b26e-7b1ccb58aa47</entry>
Apr 14 12:05:29 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:05:29 user nova-compute[71330]:     </system>
Apr 14 12:05:29 user nova-compute[71330]:   </sysinfo>
Apr 14 12:05:29 user nova-compute[71330]:   <os>
Apr 14 12:05:29 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:05:29 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:05:29 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:05:29 user nova-compute[71330]:   </os>
Apr 14 12:05:29 user nova-compute[71330]:   <features>
Apr 14 12:05:29 user nova-compute[71330]:     <acpi/>
Apr 14 12:05:29 user nova-compute[71330]:     <apic/>
Apr 14 12:05:29 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:05:29 user nova-compute[71330]:   </features>
Apr 14 12:05:29 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:05:29 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:05:29 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:05:29 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:05:29 user nova-compute[71330]:   </clock>
Apr 14 12:05:29 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:05:29 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:05:29 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:05:29 user nova-compute[71330]:   </cpu>
Apr 14 12:05:29 user nova-compute[71330]:   <devices>
Apr 14 12:05:29 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:05:29 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:05:29 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk"/>
Apr 14 12:05:29 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:05:29 user nova-compute[71330]:     </disk>
Apr 14 12:05:29 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:05:29 user nova-compute[71330]:       <mac address="fa:16:3e:5e:c2:00"/>
Apr 14 12:05:29 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:05:29 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:05:29 user nova-compute[71330]:       <target dev="tap3ba9407c-34"/>
Apr 14 12:05:29 user nova-compute[71330]:     </interface>
Apr 14 12:05:29 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:05:29 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/console.log" append="off"/>
Apr 14 12:05:29 user nova-compute[71330]:     </serial>
Apr 14 12:05:29 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:05:29 user nova-compute[71330]:     <video>
Apr 14 12:05:29 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:05:29 user nova-compute[71330]:     </video>
Apr 14 12:05:29 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:05:29 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:05:29 user nova-compute[71330]:     </rng>
Apr 14 12:05:29 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:05:29 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:05:29 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:05:29 user nova-compute[71330]:     </memballoon>
Apr 14 12:05:29 user nova-compute[71330]:   </devices>
Apr 14 12:05:29 user nova-compute[71330]: </domain>
Apr 14 12:05:29 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1425077184',display_name='tempest-ServerRescueNegativeTestJSON-server-1425077184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1425077184',id=23,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChwBqnED/n2nWrN2SoLSMRhqkE84LnQSbYpaeWVgLfUiXzTqQT/5YeOR1ydLbZ836JaTZWc0GepItYuqZ/dHFeEKlQx8bHxyYpEaXK0Bnde9kYWx5+wzLpg/aD1Yl4K9A==',key_name='tempest-keypair-1239489635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-x76brrrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=4595c0e6-f2af-47ef-b26e-7b1ccb58aa47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c2:00,bridge_name='br-int',has_traffic_filtering=True,id=3ba9407c-344c-45b8-a483-36e0c0e72ff0,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9407c-34') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG os_vif [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c2:00,bridge_name='br-int',has_traffic_filtering=True,id=3ba9407c-344c-45b8-a483-36e0c0e72ff0,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9407c-34') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ba9407c-34, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ba9407c-34, col_values=(('external_ids', {'iface-id': '3ba9407c-344c-45b8-a483-36e0c0e72ff0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:c2:00', 'vm-uuid': '4595c0e6-f2af-47ef-b26e-7b1ccb58aa47'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:29 user nova-compute[71330]: INFO os_vif [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c2:00,bridge_name='br-int',has_traffic_filtering=True,id=3ba9407c-344c-45b8-a483-36e0c0e72ff0,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9407c-34')
Apr 14 12:05:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No VIF found with MAC fa:16:3e:5e:c2:00, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] No waiting events found dispatching network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:29 user nova-compute[71330]: WARNING nova.compute.manager [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received unexpected event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e for instance with vm_state building and task_state spawning.
Apr 14 12:05:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:30 user nova-compute[71330]: DEBUG nova.network.neutron [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updated VIF entry in instance network info cache for port 3ba9407c-344c-45b8-a483-36e0c0e72ff0. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:05:30 user nova-compute[71330]: DEBUG nova.network.neutron [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating instance_info_cache with network_info: [{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] Releasing lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:05:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] No waiting events found dispatching network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:32 user nova-compute[71330]: WARNING nova.compute.manager [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received unexpected event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e for instance with vm_state building and task_state spawning.
Apr 14 12:05:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:32 user nova-compute[71330]: WARNING nova.compute.manager [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state rebuild_spawning.
Apr 14 12:05:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473919.1171703, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:05:34 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Stopped (Lifecycle Event)
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-0a2b8375-7f80-4f68-9c28-b14943404fb7 None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:34 user nova-compute[71330]: WARNING nova.compute.manager [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state rebuild_spawning.
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:34 user nova-compute[71330]: WARNING nova.compute.manager [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state building and task_state spawning.
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:34 user nova-compute[71330]: WARNING nova.compute.manager [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state building and task_state spawning.
Apr 14 12:05:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473934.7616954, b79d8978-9bc5-4a22-98cf-025f949dc1bc => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:05:34 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] VM Resumed (Lifecycle Event)
Apr 14 12:05:34 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Instance spawned successfully.
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:05:34 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473934.7628126, b79d8978-9bc5-4a22-98cf-025f949dc1bc => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:05:34 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] VM Started (Lifecycle Event)
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:34 user nova-compute[71330]: INFO nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Took 10.13 seconds to spawn the instance on the hypervisor.
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473935.0144987, 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] VM Resumed (Lifecycle Event)
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Instance spawned successfully.
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Took 11.01 seconds to build instance.
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473935.0183904, 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] VM Started (Lifecycle Event)
Apr 14 12:05:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.128s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Took 7.54 seconds to spawn the instance on the hypervisor.
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473935.2158334, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Resumed (Lifecycle Event)
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance spawned successfully.
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473935.2161882, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Started (Lifecycle Event)
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Took 8.56 seconds to build instance.
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.741s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71330) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 12:05:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.214s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'flavor' on Instance uuid 075f81e9-8b43-4b05-96be-6eb4cca6d812 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:39 user nova-compute[71330]: INFO nova.compute.manager [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Attaching volume b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 to /dev/vdb
Apr 14 12:05:40 user nova-compute[71330]: DEBUG os_brick.utils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c614b18-7352-4882-af01-812a2d6488fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7040936-f434-4ffd-a4da-daa126576a30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95a0007-6b89-44ca-ac9b-f4280cca017c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc57116e-19d5-46d1-a16a-e31557d1759e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:05:40 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:05:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[60af6b31-33fd-4ca4-9704-7d31110fe27d]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG os_brick.utils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:05:40 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updating existing volume attachment record: ab87ea86-25e7-4d98-b66d-a7dd2feb0973 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:05:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUMlQZHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:05:45 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:05:45 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:05:45 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3b5dc3-5df7-4752-9437-4eb041b468d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:05:45 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a73026-b877-4813-a86f-eac7cd5cadd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2] added
Apr 14 12:05:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae194411-b5e2-4d45-8a3e-48a4965eb0dc]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.129s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf053c4-8a7d-4ccf-9c85-fb48162392b7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUMlQZHC {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUMlQZHC" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f678e40b-6903-44ab-b6c3-94296b4ae9ec]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nUMlQZHC'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[520d03dc-f456-416a-8bc7-1fb2f3e34760]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcdf8e4-bfeb-4dbc-9fc7-35368525e8ab]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:45 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:45 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a694b265-647b-43b1-8d21-9d6b94c88f36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2, portal: 172.16.0.220,3260]
Apr 14 12:05:45 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2, portal: 172.16.0.220,3260] successful.
Apr 14 12:05:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46d8133-2241-4fc1-9417-8959b51a10ee]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[141edf88-3a45-4546-9844-3234770589a7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:45 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:45 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:05:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:05:45 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:05:45 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:05:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[94460bd4-983f-4e2d-b450-65d2b0dcce3e]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:05:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUMlQZHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23736386230363065', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736386230363065', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'flavor' on Instance uuid 075f81e9-8b43-4b05-96be-6eb4cca6d812 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:05:46 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:05:46 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:05:46 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:05:46 user nova-compute[71330]:   <serial>b62c6d91-1d0e-42a1-ae0e-68e03d7992d2</serial>
Apr 14 12:05:46 user nova-compute[71330]: </disk>
Apr 14 12:05:46 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:05:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] No VIF found with MAC fa:16:3e:db:5e:1a, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updating instance_info_cache with network_info: [{"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.258s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:05:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing instance network info cache due to event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] Acquiring lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] Acquired lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG nova.network.neutron [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG nova.network.neutron [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updated VIF entry in instance network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG nova.network.neutron [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updating instance_info_cache with network_info: [{"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] Releasing lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:05:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing instance network info cache due to event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] Acquiring lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] Acquired lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG nova.network.neutron [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:52 user nova-compute[71330]: INFO nova.compute.manager [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Rebooting instance
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:05:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updated VIF entry in instance network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updating instance_info_cache with network_info: [{"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] Releasing lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquired lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updating instance_info_cache with network_info: [{"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Releasing lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:54 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:05:54 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:05:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7496MB free_disk=26.13751220703125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:55 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:05:55 user nova-compute[71330]: INFO nova.compute.claims [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Claim successful on node user
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.network.neutron [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:05:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-unplugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.compute.manager [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] No waiting events found dispatching network-vif-unplugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:56 user nova-compute[71330]: WARNING nova.compute.manager [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received unexpected event network-vif-unplugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance with vm_state active and task_state reboot_started.
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.policy [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61adadbd79ef493889ef3dcb63f63fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5ac6388692423b9bf23bf6be0cb06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:05:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Creating image(s)
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "/opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "/opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk 1073741824" returned: 0 in 0.055s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.155s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:05:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Instance shutdown successfully.
Apr 14 12:05:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Cannot resize image /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG nova.objects.instance [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'migration_context' on Instance uuid bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Ensure instance console log exists: /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:57 user nova-compute[71330]: DEBUG nova.network.neutron [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Successfully created port: 2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.network.neutron [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Successfully updated port: 2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "refresh_cache-bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquired lock "refresh_cache-bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.network.neutron [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.network.neutron [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] No waiting events found dispatching network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:05:58 user nova-compute[71330]: WARNING nova.compute.manager [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received unexpected event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance with vm_state active and task_state reboot_started.
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-changed-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Refreshing instance network info cache due to event network-changed-2f1bec16-15b5-414a-aeb9-19c6e8694096. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Acquiring lock "refresh_cache-bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.network.neutron [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Updating instance_info_cache with network_info: [{"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Releasing lock "refresh_cache-bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Instance network_info: |[{"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Acquired lock "refresh_cache-bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.network.neutron [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Refreshing network info cache for port 2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Start _get_guest_xml network_info=[{"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:05:58 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:05:58 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1254198979',display_name='tempest-VolumesSnapshotTestJSON-instance-1254198979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1254198979',id=24,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5ac6388692423b9bf23bf6be0cb06d',ramdisk_id='',reservation_id='r-78baruou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1634639087',owner_user_name='tempest-VolumesSnapshotTestJSON-1634639087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:56Z,user_data=None,user_id='61adadbd79ef493889ef3dcb63f63fd8',uuid=bf72b2ec-5763-47e9-b9a8-b0cf9df9d649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converting VIF {"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=2f1bec16-15b5-414a-aeb9-19c6e8694096,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1bec16-15') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.objects.instance [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'pci_devices' on Instance uuid bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:05:58 user nova-compute[71330]:   <uuid>bf72b2ec-5763-47e9-b9a8-b0cf9df9d649</uuid>
Apr 14 12:05:58 user nova-compute[71330]:   <name>instance-00000018</name>
Apr 14 12:05:58 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:05:58 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:05:58 user nova-compute[71330]:   <metadata>
Apr 14 12:05:58 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:05:58 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:05:58 user nova-compute[71330]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1254198979</nova:name>
Apr 14 12:05:58 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:05:58</nova:creationTime>
Apr 14 12:05:58 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:05:58 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:05:58 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:05:58 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:05:58 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:05:58 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:05:58 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:05:58 user nova-compute[71330]:       <nova:owner>
Apr 14 12:05:58 user nova-compute[71330]:         <nova:user uuid="61adadbd79ef493889ef3dcb63f63fd8">tempest-VolumesSnapshotTestJSON-1634639087-project-member</nova:user>
Apr 14 12:05:58 user nova-compute[71330]:         <nova:project uuid="ae5ac6388692423b9bf23bf6be0cb06d">tempest-VolumesSnapshotTestJSON-1634639087</nova:project>
Apr 14 12:05:58 user nova-compute[71330]:       </nova:owner>
Apr 14 12:05:58 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:05:58 user nova-compute[71330]:       <nova:ports>
Apr 14 12:05:58 user nova-compute[71330]:         <nova:port uuid="2f1bec16-15b5-414a-aeb9-19c6e8694096">
Apr 14 12:05:58 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 12:05:58 user nova-compute[71330]:         </nova:port>
Apr 14 12:05:58 user nova-compute[71330]:       </nova:ports>
Apr 14 12:05:58 user nova-compute[71330]:     </nova:instance>
Apr 14 12:05:58 user nova-compute[71330]:   </metadata>
Apr 14 12:05:58 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:05:58 user nova-compute[71330]:     <system>
Apr 14 12:05:58 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:05:58 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:05:58 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:05:58 user nova-compute[71330]:       <entry name="serial">bf72b2ec-5763-47e9-b9a8-b0cf9df9d649</entry>
Apr 14 12:05:58 user nova-compute[71330]:       <entry name="uuid">bf72b2ec-5763-47e9-b9a8-b0cf9df9d649</entry>
Apr 14 12:05:58 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:05:58 user nova-compute[71330]:     </system>
Apr 14 12:05:58 user nova-compute[71330]:   </sysinfo>
Apr 14 12:05:58 user nova-compute[71330]:   <os>
Apr 14 12:05:58 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:05:58 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:05:58 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:05:58 user nova-compute[71330]:   </os>
Apr 14 12:05:58 user nova-compute[71330]:   <features>
Apr 14 12:05:58 user nova-compute[71330]:     <acpi/>
Apr 14 12:05:58 user nova-compute[71330]:     <apic/>
Apr 14 12:05:58 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:05:58 user nova-compute[71330]:   </features>
Apr 14 12:05:58 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:05:58 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:05:58 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:05:58 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:05:58 user nova-compute[71330]:   </clock>
Apr 14 12:05:58 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:05:58 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:05:58 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:05:58 user nova-compute[71330]:   </cpu>
Apr 14 12:05:58 user nova-compute[71330]:   <devices>
Apr 14 12:05:58 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:05:58 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:05:58 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk"/>
Apr 14 12:05:58 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:05:58 user nova-compute[71330]:     </disk>
Apr 14 12:05:58 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:05:58 user nova-compute[71330]:       <mac address="fa:16:3e:a0:8a:b3"/>
Apr 14 12:05:58 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:05:58 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:05:58 user nova-compute[71330]:       <target dev="tap2f1bec16-15"/>
Apr 14 12:05:58 user nova-compute[71330]:     </interface>
Apr 14 12:05:58 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:05:58 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/console.log" append="off"/>
Apr 14 12:05:58 user nova-compute[71330]:     </serial>
Apr 14 12:05:58 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:05:58 user nova-compute[71330]:     <video>
Apr 14 12:05:58 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:05:58 user nova-compute[71330]:     </video>
Apr 14 12:05:58 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:05:58 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:05:58 user nova-compute[71330]:     </rng>
Apr 14 12:05:58 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:05:58 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:05:58 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:05:58 user nova-compute[71330]:     </memballoon>
Apr 14 12:05:58 user nova-compute[71330]:   </devices>
Apr 14 12:05:58 user nova-compute[71330]: </domain>
Apr 14 12:05:58 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1254198979',display_name='tempest-VolumesSnapshotTestJSON-instance-1254198979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1254198979',id=24,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5ac6388692423b9bf23bf6be0cb06d',ramdisk_id='',reservation_id='r-78baruou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1634639087',owner_user_name='tempest-VolumesSnapshotTestJSON-1634639087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:56Z,user_data=None,user_id='61adadbd79ef493889ef3dcb63f63fd8',uuid=bf72b2ec-5763-47e9-b9a8-b0cf9df9d649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converting VIF {"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=2f1bec16-15b5-414a-aeb9-19c6e8694096,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1bec16-15') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG os_vif [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=2f1bec16-15b5-414a-aeb9-19c6e8694096,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1bec16-15') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f1bec16-15, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f1bec16-15, col_values=(('external_ids', {'iface-id': '2f1bec16-15b5-414a-aeb9-19c6e8694096', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:8a:b3', 'vm-uuid': 'bf72b2ec-5763-47e9-b9a8-b0cf9df9d649'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:58 user nova-compute[71330]: INFO os_vif [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=2f1bec16-15b5-414a-aeb9-19c6e8694096,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1bec16-15')
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:05:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No VIF found with MAC fa:16:3e:a0:8a:b3, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:05:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:05:59 user nova-compute[71330]: DEBUG nova.network.neutron [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Updated VIF entry in instance network info cache for port 2f1bec16-15b5-414a-aeb9-19c6e8694096. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:05:59 user nova-compute[71330]: DEBUG nova.network.neutron [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Updating instance_info_cache with network_info: [{"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:05:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Releasing lock "refresh_cache-bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] No waiting events found dispatching network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:00 user nova-compute[71330]: WARNING nova.compute.manager [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received unexpected event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance with vm_state active and task_state reboot_started.
Apr 14 12:06:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] No waiting events found dispatching network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:00 user nova-compute[71330]: WARNING nova.compute.manager [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received unexpected event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance with vm_state active and task_state reboot_started.
Apr 14 12:06:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] No waiting events found dispatching network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:00 user nova-compute[71330]: WARNING nova.compute.manager [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received unexpected event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance with vm_state building and task_state spawning.
Apr 14 12:06:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 075f81e9-8b43-4b05-96be-6eb4cca6d812 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:06:01 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473961.8491056, 075f81e9-8b43-4b05-96be-6eb4cca6d812 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:06:01 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] VM Resumed (Lifecycle Event)
Apr 14 12:06:01 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Instance running successfully.
Apr 14 12:06:01 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Instance soft rebooted successfully.
Apr 14 12:06:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:06:01 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 12:06:01 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473961.8514695, 075f81e9-8b43-4b05-96be-6eb4cca6d812 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:06:01 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] VM Started (Lifecycle Event)
Apr 14 12:06:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.060s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473962.5328717, bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:06:02 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] VM Resumed (Lifecycle Event)
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:06:02 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Instance spawned successfully.
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] No waiting events found dispatching network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:02 user nova-compute[71330]: WARNING nova.compute.manager [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received unexpected event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance with vm_state building and task_state spawning.
Apr 14 12:06:02 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473962.5340524, bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:06:02 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] VM Started (Lifecycle Event)
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:06:02 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:06:02 user nova-compute[71330]: INFO nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Took 6.19 seconds to spawn the instance on the hypervisor.
Apr 14 12:06:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:02 user nova-compute[71330]: INFO nova.compute.manager [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Took 7.05 seconds to build instance.
Apr 14 12:06:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.160s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-changed-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Refreshing instance network info cache due to event network-changed-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:06:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] Acquiring lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] Acquired lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:13 user nova-compute[71330]: DEBUG nova.network.neutron [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Refreshing network info cache for port 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:06:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updated VIF entry in instance network info cache for port 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:06:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updating instance_info_cache with network_info: [{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] Releasing lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:17 user nova-compute[71330]: INFO nova.compute.manager [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Shelving
Apr 14 12:06:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-unplugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-unplugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:17 user nova-compute[71330]: WARNING nova.compute.manager [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-unplugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state active and task_state shelving.
Apr 14 12:06:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:17 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance destroyed successfully.
Apr 14 12:06:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:17 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Beginning cold snapshot process
Apr 14 12:06:18 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:06:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk /opt/stack/data/nova/instances/snapshots/tmp5w8568no/03794beac1b647b388429496c4bef527 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk /opt/stack/data/nova/instances/snapshots/tmp5w8568no/03794beac1b647b388429496c4bef527" returned: 0 in 0.517s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Snapshot extracted, beginning image upload
Apr 14 12:06:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:19 user nova-compute[71330]: WARNING nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:19 user nova-compute[71330]: WARNING nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:19 user nova-compute[71330]: WARNING nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-unplugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-unplugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:19 user nova-compute[71330]: WARNING nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-unplugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:19 user nova-compute[71330]: WARNING nova.compute.manager [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-changed-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Refreshing instance network info cache due to event network-changed-4eea14b0-9a05-4eb6-a383-586a5eeb0622. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] Acquiring lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] Acquired lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Refreshing network info cache for port 4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "interface-8f409eb4-2ec5-4481-9cef-5524ec2ae58b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "interface-8f409eb4-2ec5-4481-9cef-5524ec2ae58b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'flavor' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updated VIF entry in instance network info cache for port 4eea14b0-9a05-4eb6-a383-586a5eeb0622. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updating instance_info_cache with network_info: [{"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'pci_requests' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] Releasing lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:20 user nova-compute[71330]: DEBUG nova.policy [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:06:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Snapshot image upload complete
Apr 14 12:06:20 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:21 user nova-compute[71330]: INFO nova.compute.manager [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Shelve offloading
Apr 14 12:06:21 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance destroyed successfully.
Apr 14 12:06:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquired lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:21 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:06:22 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updating instance_info_cache with network_info: [{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Releasing lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:22 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Successfully created port: 2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:06:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance destroyed successfully.
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'resources' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-549197077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-549197077',id=20,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhVkEGSeuEZ8Y3htZW1HZinPHvrQPcgejbT/OFh6MfFN2VsnJTbLJi/gTpjMXD41LAKZDrh6KlePbKIa4x2/AbhT90RWYLa4yStEwS5RH7EDrtgqbiBmKAuxLp4/ClApA==',key_name='tempest-keypair-230816513',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:04:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-q4keusmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member',shelved_at='2023-04-14T12:06:20.969478',shelved_host='user',shelved_image_id='a1c2deb6-1fbe-4cd0-8501-169df29549e1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=5181aed1-2933-4b33-893e-eb30a0d4ff4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG os_vif [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap923fca3f-14, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.compute.manager [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-changed-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.compute.manager [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Refreshing instance network info cache due to event network-changed-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] Acquiring lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] Acquired lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.network.neutron [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Refreshing network info cache for port 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:06:23 user nova-compute[71330]: INFO os_vif [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14')
Apr 14 12:06:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Deleting instance files /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c_del
Apr 14 12:06:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Deletion of /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c_del complete
Apr 14 12:06:23 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Deleted allocations for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c
Apr 14 12:06:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'numa_topology' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Successfully updated port: 2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquired lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.691s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.network.neutron [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updated VIF entry in instance network info cache for port 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.network.neutron [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updating instance_info_cache with network_info: [{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap923fca3f-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] Releasing lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updating instance_info_cache with network_info: [{"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Releasing lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T12:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-768440337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-768440337',id=21,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwvNK99UVRoZeGKk1C2aKDber+NGXwjSb1OF7CVugl+yUKmkGvJI0M5s8sT36aK2k1pNTrMWaY3J39RsxSA0phyvF4PsH3ppSI9HKHL4P2z4EBsY+MbMNsbgNVmcGY86Q==',key_name='tempest-keypair-1300651092',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1020d6403b140d7bd28467afcabf8ae',ramdisk_id='',reservation_id='r-fc4zikbk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431365023',owner_user_name='tempest-TaggedAttachmentsTest-1431365023-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6bb5d52609d47e38856a32e3b847bc6',uuid=8f409eb4-2ec5-4481-9cef-5524ec2ae58b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converting VIF {"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:16:01,bridge_name='br-int',has_traffic_filtering=True,id=2c916396-3333-46ee-bd7f-3476c2980e51,network=Network(47a303ab-2823-4049-89ed-7ceeb77b4162),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c916396-33') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG os_vif [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:16:01,bridge_name='br-int',has_traffic_filtering=True,id=2c916396-3333-46ee-bd7f-3476c2980e51,network=Network(47a303ab-2823-4049-89ed-7ceeb77b4162),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c916396-33') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c916396-33, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c916396-33, col_values=(('external_ids', {'iface-id': '2c916396-3333-46ee-bd7f-3476c2980e51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:16:01', 'vm-uuid': '8f409eb4-2ec5-4481-9cef-5524ec2ae58b'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:24 user nova-compute[71330]: INFO os_vif [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:16:01,bridge_name='br-int',has_traffic_filtering=True,id=2c916396-3333-46ee-bd7f-3476c2980e51,network=Network(47a303ab-2823-4049-89ed-7ceeb77b4162),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c916396-33')
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T12:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-768440337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-768440337',id=21,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwvNK99UVRoZeGKk1C2aKDber+NGXwjSb1OF7CVugl+yUKmkGvJI0M5s8sT36aK2k1pNTrMWaY3J39RsxSA0phyvF4PsH3ppSI9HKHL4P2z4EBsY+MbMNsbgNVmcGY86Q==',key_name='tempest-keypair-1300651092',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1020d6403b140d7bd28467afcabf8ae',ramdisk_id='',reservation_id='r-fc4zikbk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431365023',owner_user_name='tempest-TaggedAttachmentsTest-1431365023-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6bb5d52609d47e38856a32e3b847bc6',uuid=8f409eb4-2ec5-4481-9cef-5524ec2ae58b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converting VIF {"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:16:01,bridge_name='br-int',has_traffic_filtering=True,id=2c916396-3333-46ee-bd7f-3476c2980e51,network=Network(47a303ab-2823-4049-89ed-7ceeb77b4162),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c916396-33') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] attach device xml: <interface type="ethernet">
Apr 14 12:06:24 user nova-compute[71330]:   <mac address="fa:16:3e:59:16:01"/>
Apr 14 12:06:24 user nova-compute[71330]:   <model type="virtio"/>
Apr 14 12:06:24 user nova-compute[71330]:   <mtu size="1442"/>
Apr 14 12:06:24 user nova-compute[71330]:   <target dev="tap2c916396-33"/>
Apr 14 12:06:24 user nova-compute[71330]: </interface>
Apr 14 12:06:24 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] No BDM found with device name hda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] No VIF found with MAC fa:16:3e:cb:97:28, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:06:25 user nova-compute[71330]:   <nova:package version="0.0.0"/>
Apr 14 12:06:25 user nova-compute[71330]:   <nova:name>tempest-device-tagging-server-768440337</nova:name>
Apr 14 12:06:25 user nova-compute[71330]:   <nova:creationTime>2023-04-14 12:06:25</nova:creationTime>
Apr 14 12:06:25 user nova-compute[71330]:   <nova:flavor name="m1.nano">
Apr 14 12:06:25 user nova-compute[71330]:     <nova:memory>128</nova:memory>
Apr 14 12:06:25 user nova-compute[71330]:     <nova:disk>1</nova:disk>
Apr 14 12:06:25 user nova-compute[71330]:     <nova:swap>0</nova:swap>
Apr 14 12:06:25 user nova-compute[71330]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:06:25 user nova-compute[71330]:     <nova:vcpus>1</nova:vcpus>
Apr 14 12:06:25 user nova-compute[71330]:   </nova:flavor>
Apr 14 12:06:25 user nova-compute[71330]:   <nova:owner>
Apr 14 12:06:25 user nova-compute[71330]:     <nova:user uuid="e6bb5d52609d47e38856a32e3b847bc6">tempest-TaggedAttachmentsTest-1431365023-project-member</nova:user>
Apr 14 12:06:25 user nova-compute[71330]:     <nova:project uuid="a1020d6403b140d7bd28467afcabf8ae">tempest-TaggedAttachmentsTest-1431365023</nova:project>
Apr 14 12:06:25 user nova-compute[71330]:   </nova:owner>
Apr 14 12:06:25 user nova-compute[71330]:   <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:06:25 user nova-compute[71330]:   <nova:ports>
Apr 14 12:06:25 user nova-compute[71330]:     <nova:port uuid="4eea14b0-9a05-4eb6-a383-586a5eeb0622">
Apr 14 12:06:25 user nova-compute[71330]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 12:06:25 user nova-compute[71330]:     </nova:port>
Apr 14 12:06:25 user nova-compute[71330]:     <nova:port uuid="2c916396-3333-46ee-bd7f-3476c2980e51">
Apr 14 12:06:25 user nova-compute[71330]:       <nova:ip type="fixed" address="10.10.10.90" ipVersion="4"/>
Apr 14 12:06:25 user nova-compute[71330]:     </nova:port>
Apr 14 12:06:25 user nova-compute[71330]:   </nova:ports>
Apr 14 12:06:25 user nova-compute[71330]: </nova:instance>
Apr 14 12:06:25 user nova-compute[71330]:  {{(pid=71330) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "interface-8f409eb4-2ec5-4481-9cef-5524ec2ae58b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.676s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.compute.manager [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-changed-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.compute.manager [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Refreshing instance network info cache due to event network-changed-2c916396-3333-46ee-bd7f-3476c2980e51. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Acquiring lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Acquired lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.network.neutron [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Refreshing network info cache for port 2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.objects.instance [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'flavor' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.161s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:25 user nova-compute[71330]: INFO nova.compute.manager [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Attaching volume 798cf245-59e4-4a38-8e64-1cc8a807bf31 to /dev/vdb
Apr 14 12:06:25 user nova-compute[71330]: DEBUG os_brick.utils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb62d3e-1270-418f-914e-76cec2cd7e1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.network.neutron [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updated VIF entry in instance network info cache for port 2c916396-3333-46ee-bd7f-3476c2980e51. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.network.neutron [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updating instance_info_cache with network_info: [{"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cf7a4f-8a21-487e-9ca7-068b2b888162]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Releasing lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.compute.manager [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-plugged-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.compute.manager [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] No waiting events found dispatching network-vif-plugged-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:25 user nova-compute[71330]: WARNING nova.compute.manager [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received unexpected event network-vif-plugged-2c916396-3333-46ee-bd7f-3476c2980e51 for instance with vm_state active and task_state None.
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.compute.manager [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-plugged-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.compute.manager [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] No waiting events found dispatching network-vif-plugged-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:25 user nova-compute[71330]: WARNING nova.compute.manager [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received unexpected event network-vif-plugged-2c916396-3333-46ee-bd7f-3476c2980e51 for instance with vm_state active and task_state None.
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[78de037d-caeb-4d86-818a-f2daeea36ffe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7561f90c-f056-4c5f-a4a6-f43435385ca4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:06:25 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:06:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[27719b3d-a72c-44d8-a649-b7f42e328a71]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG os_brick.utils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:06:25 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updating existing volume attachment record: a4b4df98-aa8f-4663-9b12-e51e8a4f9e09 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:06:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "545be51c-649c-4297-a924-bbb6ecf303dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "545be51c-649c-4297-a924-bbb6ecf303dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:26 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:06:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:06:26 user nova-compute[71330]: INFO nova.compute.claims [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Claim successful on node user
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:06:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.policy [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:06:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Creating image(s)
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "/opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "/opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "/opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk 1073741824" returned: 0 in 0.056s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Checking if we can resize image /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:06:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Successfully created port: 2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Cannot resize image /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'migration_context' on Instance uuid 545be51c-649c-4297-a924-bbb6ecf303dd {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Ensure instance console log exists: /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Successfully updated port: 2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "refresh_cache-545be51c-649c-4297-a924-bbb6ecf303dd" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquired lock "refresh_cache-545be51c-649c-4297-a924-bbb6ecf303dd" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received event network-changed-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Refreshing instance network info cache due to event network-changed-2a8170c7-6a56-4654-a6ef-95dc8f0957dd. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] Acquiring lock "refresh_cache-545be51c-649c-4297-a924-bbb6ecf303dd" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Updating instance_info_cache with network_info: [{"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Releasing lock "refresh_cache-545be51c-649c-4297-a924-bbb6ecf303dd" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Instance network_info: |[{"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] Acquired lock "refresh_cache-545be51c-649c-4297-a924-bbb6ecf303dd" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.network.neutron [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Refreshing network info cache for port 2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Start _get_guest_xml network_info=[{"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:06:29 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:06:29 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-247540869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-247540869',id=25,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-qi4jr6rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:06:27Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=545be51c-649c-4297-a924-bbb6ecf303dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:39:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a8170c7-6a56-4654-a6ef-95dc8f0957dd,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a8170c7-6a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'pci_devices' on Instance uuid 545be51c-649c-4297-a924-bbb6ecf303dd {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:06:29 user nova-compute[71330]:   <uuid>545be51c-649c-4297-a924-bbb6ecf303dd</uuid>
Apr 14 12:06:29 user nova-compute[71330]:   <name>instance-00000019</name>
Apr 14 12:06:29 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:06:29 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:06:29 user nova-compute[71330]:   <metadata>
Apr 14 12:06:29 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:06:29 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:06:29 user nova-compute[71330]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-247540869</nova:name>
Apr 14 12:06:29 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:06:29</nova:creationTime>
Apr 14 12:06:29 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:06:29 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:06:29 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:06:29 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:06:29 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:06:29 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:06:29 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:06:29 user nova-compute[71330]:       <nova:owner>
Apr 14 12:06:29 user nova-compute[71330]:         <nova:user uuid="11df88c60e4b456691d8731fe8facf38">tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member</nova:user>
Apr 14 12:06:29 user nova-compute[71330]:         <nova:project uuid="2c5140d4419e43be941c2ac5d5439e35">tempest-ServerBootFromVolumeStableRescueTest-1565599676</nova:project>
Apr 14 12:06:29 user nova-compute[71330]:       </nova:owner>
Apr 14 12:06:29 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:06:29 user nova-compute[71330]:       <nova:ports>
Apr 14 12:06:29 user nova-compute[71330]:         <nova:port uuid="2a8170c7-6a56-4654-a6ef-95dc8f0957dd">
Apr 14 12:06:29 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 12:06:29 user nova-compute[71330]:         </nova:port>
Apr 14 12:06:29 user nova-compute[71330]:       </nova:ports>
Apr 14 12:06:29 user nova-compute[71330]:     </nova:instance>
Apr 14 12:06:29 user nova-compute[71330]:   </metadata>
Apr 14 12:06:29 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:06:29 user nova-compute[71330]:     <system>
Apr 14 12:06:29 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:06:29 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:06:29 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:06:29 user nova-compute[71330]:       <entry name="serial">545be51c-649c-4297-a924-bbb6ecf303dd</entry>
Apr 14 12:06:29 user nova-compute[71330]:       <entry name="uuid">545be51c-649c-4297-a924-bbb6ecf303dd</entry>
Apr 14 12:06:29 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:06:29 user nova-compute[71330]:     </system>
Apr 14 12:06:29 user nova-compute[71330]:   </sysinfo>
Apr 14 12:06:29 user nova-compute[71330]:   <os>
Apr 14 12:06:29 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:06:29 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:06:29 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:06:29 user nova-compute[71330]:   </os>
Apr 14 12:06:29 user nova-compute[71330]:   <features>
Apr 14 12:06:29 user nova-compute[71330]:     <acpi/>
Apr 14 12:06:29 user nova-compute[71330]:     <apic/>
Apr 14 12:06:29 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:06:29 user nova-compute[71330]:   </features>
Apr 14 12:06:29 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:06:29 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:06:29 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:06:29 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:06:29 user nova-compute[71330]:   </clock>
Apr 14 12:06:29 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:06:29 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:06:29 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:06:29 user nova-compute[71330]:   </cpu>
Apr 14 12:06:29 user nova-compute[71330]:   <devices>
Apr 14 12:06:29 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:06:29 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:06:29 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk"/>
Apr 14 12:06:29 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:06:29 user nova-compute[71330]:     </disk>
Apr 14 12:06:29 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:06:29 user nova-compute[71330]:       <mac address="fa:16:3e:e3:39:d1"/>
Apr 14 12:06:29 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:06:29 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:06:29 user nova-compute[71330]:       <target dev="tap2a8170c7-6a"/>
Apr 14 12:06:29 user nova-compute[71330]:     </interface>
Apr 14 12:06:29 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:06:29 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/console.log" append="off"/>
Apr 14 12:06:29 user nova-compute[71330]:     </serial>
Apr 14 12:06:29 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:06:29 user nova-compute[71330]:     <video>
Apr 14 12:06:29 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:06:29 user nova-compute[71330]:     </video>
Apr 14 12:06:29 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:06:29 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:06:29 user nova-compute[71330]:     </rng>
Apr 14 12:06:29 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:06:29 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:06:29 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:06:29 user nova-compute[71330]:     </memballoon>
Apr 14 12:06:29 user nova-compute[71330]:   </devices>
Apr 14 12:06:29 user nova-compute[71330]: </domain>
Apr 14 12:06:29 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-247540869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-247540869',id=25,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-qi4jr6rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:06:27Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=545be51c-649c-4297-a924-bbb6ecf303dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:39:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a8170c7-6a56-4654-a6ef-95dc8f0957dd,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a8170c7-6a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG os_vif [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:39:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a8170c7-6a56-4654-a6ef-95dc8f0957dd,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a8170c7-6a') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a8170c7-6a, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a8170c7-6a, col_values=(('external_ids', {'iface-id': '2a8170c7-6a56-4654-a6ef-95dc8f0957dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:39:d1', 'vm-uuid': '545be51c-649c-4297-a924-bbb6ecf303dd'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:29 user nova-compute[71330]: INFO os_vif [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:39:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a8170c7-6a56-4654-a6ef-95dc8f0957dd,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a8170c7-6a')
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:06:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No VIF found with MAC fa:16:3e:e3:39:d1, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG nova.network.neutron [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Updated VIF entry in instance network info cache for port 2a8170c7-6a56-4654-a6ef-95dc8f0957dd. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG nova.network.neutron [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Updating instance_info_cache with network_info: [{"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] Releasing lock "refresh_cache-545be51c-649c-4297-a924-bbb6ecf303dd" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQAewhTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:06:30 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:06:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:06:30 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:06:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:06:30 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:06:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[85915952-38fb-40fd-9f55-b2f744167bf6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:06:30 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a988f71-247c-45c1-bc17-080cb0b98464]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31] added
Apr 14 12:06:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd9a8cd-18ae-4b25-8643-1b6ab5c66955]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07678bd-6d4c-43c6-b14f-f257d4aab08e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQAewhTD {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQAewhTD" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[369de467-f7e2-469d-92db-90710ccfdb67]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQAewhTD'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.137s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[556e1d91-1970-44df-be67-bf0c4fdd6714]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f768cb61-3aec-4ee7-88fd-1478204b7abe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d367bb2b-d154-4f42-98c5-589a22927ed6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31, portal: 172.16.0.220,3260]
Apr 14 12:06:31 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31, portal: 172.16.0.220,3260] successful.
Apr 14 12:06:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed72a3-9600-42c2-9b6b-c5db8b6bc624]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f526e2-8d12-4a96-87dc-47d0f9c225ff]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 (non-flash)
Apr 14 12:06:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.462s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6146b57d-a8df-4b90-93c6-8a99f54c94e7]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQAewhTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received event network-vif-plugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] Acquiring lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] No waiting events found dispatching network-vif-plugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:31 user nova-compute[71330]: WARNING nova.compute.manager [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received unexpected event network-vif-plugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance with vm_state building and task_state spawning.
Apr 14 12:06:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:06:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '23833323434653731', 'path': '/dev/sdd'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:06:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833323434653731', 'path': '/dev/sdd'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:06:32 user nova-compute[71330]: DEBUG nova.objects.instance [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'flavor' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:06:32 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:06:32 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:06:32 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:06:32 user nova-compute[71330]:   <serial>798cf245-59e4-4a38-8e64-1cc8a807bf31</serial>
Apr 14 12:06:32 user nova-compute[71330]: </disk>
Apr 14 12:06:32 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:06:32 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681473977.8520486, 5181aed1-2933-4b33-893e-eb30a0d4ff4c => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:06:32 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] VM Stopped (Lifecycle Event)
Apr 14 12:06:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c3f03439-89b1-493b-9019-f5f564213a83 None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:06:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] No BDM found with device name hda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:06:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] No VIF found with MAC fa:16:3e:cb:97:28, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.315s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received event network-vif-plugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] Acquiring lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] No waiting events found dispatching network-vif-plugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:33 user nova-compute[71330]: WARNING nova.compute.manager [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received unexpected event network-vif-plugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance with vm_state building and task_state spawning.
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473993.6137295, 545be51c-649c-4297-a924-bbb6ecf303dd => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:06:33 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] VM Resumed (Lifecycle Event)
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:06:33 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Instance spawned successfully.
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:06:33 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681473993.6169791, 545be51c-649c-4297-a924-bbb6ecf303dd => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:06:33 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] VM Started (Lifecycle Event)
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:06:33 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:06:33 user nova-compute[71330]: INFO nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Took 6.33 seconds to spawn the instance on the hypervisor.
Apr 14 12:06:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:06:33 user nova-compute[71330]: INFO nova.compute.manager [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Took 7.26 seconds to build instance.
Apr 14 12:06:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "545be51c-649c-4297-a924-bbb6ecf303dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.362s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:34 user nova-compute[71330]: INFO nova.compute.manager [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Detaching volume 798cf245-59e4-4a38-8e64-1cc8a807bf31
Apr 14 12:06:34 user nova-compute[71330]: INFO nova.virt.block_device [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Attempting to driver detach volume 798cf245-59e4-4a38-8e64-1cc8a807bf31 from mountpoint /dev/vdb
Apr 14 12:06:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Attempting to detach device vdb from instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:06:34 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:06:34 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:06:34 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:06:34 user nova-compute[71330]:   <serial>798cf245-59e4-4a38-8e64-1cc8a807bf31</serial>
Apr 14 12:06:34 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 12:06:34 user nova-compute[71330]: </disk>
Apr 14 12:06:34 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:06:34 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Successfully detached device vdb from instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b from the persistent domain config.
Apr 14 12:06:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:06:34 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:06:34 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:06:34 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:06:34 user nova-compute[71330]:   <serial>798cf245-59e4-4a38-8e64-1cc8a807bf31</serial>
Apr 14 12:06:34 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 12:06:34 user nova-compute[71330]: </disk>
Apr 14 12:06:34 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473994.9466698, 8f409eb4-2ec5-4481-9cef-5524ec2ae58b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:06:34 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Successfully detached device vdb from instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b from the live domain config.
Apr 14 12:06:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQAewhTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:06:34 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:06:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[230ba83f-c246-4d80-a394-cf8df8c883e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:06:34 user nova-compute[71330]: No targets found.
Apr 14 12:06:34 user nova-compute[71330]: iSNS:
Apr 14 12:06:34 user nova-compute[71330]: No targets found.
Apr 14 12:06:34 user nova-compute[71330]: STATIC:
Apr 14 12:06:34 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c
Apr 14 12:06:34 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:06:34 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:06:34 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31
Apr 14 12:06:34 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:06:34 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:06:34 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:06:34 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:06:34 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:06:34 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2
Apr 14 12:06:34 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:06:34 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:06:34 user nova-compute[71330]: FIRMWARE:
Apr 14 12:06:34 user nova-compute[71330]: No targets found.
Apr 14 12:06:34 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:06:35 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:06:35 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9410d1-5aed-4fa2-8036-52d2738b8ac6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ed8617-c773-49c8-a820-a03eb95611b6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:06:35 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:06:35 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:06:35 user nova-compute[71330]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 (non-flash)
Apr 14 12:06:35 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:06:35 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:06:35 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:06:35 user nova-compute[71330]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 (non-flash)
Apr 14 12:06:35 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495c3eb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31'): ({'sdd'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Removing single pathed devices sdd {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[695dbac8-12bd-4664-a380-a88736baabb2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[409305b8-174f-4903-8131-9fe94a59380d]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Flushing IO for device /dev/sdd {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3434b6-b253-4c4d-94d8-ed9f45d1fc0d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7765f405-a54e-4162-862e-e323ac26f831]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa61394-4b4d-47f6-85cd-64f9f00b6493]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c29556b-7071-4336-8ce4-949baf3d291f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31, portal: 172.16.0.220,3260]
Apr 14 12:06:35 user nova-compute[71330]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31, portal: 172.16.0.220,3260] successful.
Apr 14 12:06:35 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798cf245-59e4-4a38-8e64-1cc8a807bf31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47f1f0-f53d-4ea5-afb0-531482057157]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.515s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] <== disconnect_volume: return (517ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:06:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.objects.instance [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'flavor' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.301s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "interface-8f409eb4-2ec5-4481-9cef-5524ec2ae58b-2c916396-3333-46ee-bd7f-3476c2980e51" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "interface-8f409eb4-2ec5-4481-9cef-5524ec2ae58b-2c916396-3333-46ee-bd7f-3476c2980e51" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'flavor' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T12:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-768440337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-768440337',id=21,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwvNK99UVRoZeGKk1C2aKDber+NGXwjSb1OF7CVugl+yUKmkGvJI0M5s8sT36aK2k1pNTrMWaY3J39RsxSA0phyvF4PsH3ppSI9HKHL4P2z4EBsY+MbMNsbgNVmcGY86Q==',key_name='tempest-keypair-1300651092',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1020d6403b140d7bd28467afcabf8ae',ramdisk_id='',reservation_id='r-fc4zikbk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431365023',owner_user_name='tempest-TaggedAttachmentsTest-1431365023-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6bb5d52609d47e38856a32e3b847bc6',uuid=8f409eb4-2ec5-4481-9cef-5524ec2ae58b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converting VIF {"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:16:01,bridge_name='br-int',has_traffic_filtering=True,id=2c916396-3333-46ee-bd7f-3476c2980e51,network=Network(47a303ab-2823-4049-89ed-7ceeb77b4162),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c916396-33') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:59:16:01"/><model type="virtio"/><mtu size="1442"/><target dev="tap2c916396-33"/></interface> {{(pid=71330) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:59:16:01"/><model type="virtio"/><mtu size="1442"/><target dev="tap2c916396-33"/></interface> {{(pid=71330) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Attempting to detach device tap2c916396-33 from instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] detach device xml: <interface type="ethernet">
Apr 14 12:06:36 user nova-compute[71330]:   <mac address="fa:16:3e:59:16:01"/>
Apr 14 12:06:36 user nova-compute[71330]:   <model type="virtio"/>
Apr 14 12:06:36 user nova-compute[71330]:   <mtu size="1442"/>
Apr 14 12:06:36 user nova-compute[71330]:   <target dev="tap2c916396-33"/>
Apr 14 12:06:36 user nova-compute[71330]: </interface>
Apr 14 12:06:36 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:59:16:01"/><model type="virtio"/><mtu size="1442"/><target dev="tap2c916396-33"/></interface> {{(pid=71330) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:59:16:01"/><model type="virtio"/><mtu size="1442"/><target dev="tap2c916396-33"/></interface>not found in domain: <domain type='kvm' id='29'>
Apr 14 12:06:36 user nova-compute[71330]:   <name>instance-00000015</name>
Apr 14 12:06:36 user nova-compute[71330]:   <uuid>8f409eb4-2ec5-4481-9cef-5524ec2ae58b</uuid>
Apr 14 12:06:36 user nova-compute[71330]:   <metadata>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:06:36 user nova-compute[71330]:   <nova:package version="0.0.0"/>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:name>tempest-device-tagging-server-768440337</nova:name>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:creationTime>2023-04-14 12:06:25</nova:creationTime>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:flavor name="m1.nano">
Apr 14 12:06:36 user nova-compute[71330]:     <nova:memory>128</nova:memory>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:disk>1</nova:disk>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:swap>0</nova:swap>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:vcpus>1</nova:vcpus>
Apr 14 12:06:36 user nova-compute[71330]:   </nova:flavor>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:owner>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:user uuid="e6bb5d52609d47e38856a32e3b847bc6">tempest-TaggedAttachmentsTest-1431365023-project-member</nova:user>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:project uuid="a1020d6403b140d7bd28467afcabf8ae">tempest-TaggedAttachmentsTest-1431365023</nova:project>
Apr 14 12:06:36 user nova-compute[71330]:   </nova:owner>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:ports>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:port uuid="4eea14b0-9a05-4eb6-a383-586a5eeb0622">
Apr 14 12:06:36 user nova-compute[71330]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 12:06:36 user nova-compute[71330]:     </nova:port>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:port uuid="2c916396-3333-46ee-bd7f-3476c2980e51">
Apr 14 12:06:36 user nova-compute[71330]:       <nova:ip type="fixed" address="10.10.10.90" ipVersion="4"/>
Apr 14 12:06:36 user nova-compute[71330]:     </nova:port>
Apr 14 12:06:36 user nova-compute[71330]:   </nova:ports>
Apr 14 12:06:36 user nova-compute[71330]: </nova:instance>
Apr 14 12:06:36 user nova-compute[71330]:   </metadata>
Apr 14 12:06:36 user nova-compute[71330]:   <memory unit='KiB'>131072</memory>
Apr 14 12:06:36 user nova-compute[71330]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 12:06:36 user nova-compute[71330]:   <vcpu placement='static'>1</vcpu>
Apr 14 12:06:36 user nova-compute[71330]:   <resource>
Apr 14 12:06:36 user nova-compute[71330]:     <partition>/machine</partition>
Apr 14 12:06:36 user nova-compute[71330]:   </resource>
Apr 14 12:06:36 user nova-compute[71330]:   <sysinfo type='smbios'>
Apr 14 12:06:36 user nova-compute[71330]:     <system>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='version'>0.0.0</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='serial'>8f409eb4-2ec5-4481-9cef-5524ec2ae58b</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='uuid'>8f409eb4-2ec5-4481-9cef-5524ec2ae58b</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='family'>Virtual Machine</entry>
Apr 14 12:06:36 user nova-compute[71330]:     </system>
Apr 14 12:06:36 user nova-compute[71330]:   </sysinfo>
Apr 14 12:06:36 user nova-compute[71330]:   <os>
Apr 14 12:06:36 user nova-compute[71330]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 12:06:36 user nova-compute[71330]:     <boot dev='hd'/>
Apr 14 12:06:36 user nova-compute[71330]:     <smbios mode='sysinfo'/>
Apr 14 12:06:36 user nova-compute[71330]:   </os>
Apr 14 12:06:36 user nova-compute[71330]:   <features>
Apr 14 12:06:36 user nova-compute[71330]:     <acpi/>
Apr 14 12:06:36 user nova-compute[71330]:     <apic/>
Apr 14 12:06:36 user nova-compute[71330]:     <vmcoreinfo state='on'/>
Apr 14 12:06:36 user nova-compute[71330]:   </features>
Apr 14 12:06:36 user nova-compute[71330]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 12:06:36 user nova-compute[71330]:     <model fallback='forbid'>Nehalem</model>
Apr 14 12:06:36 user nova-compute[71330]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 12:06:36 user nova-compute[71330]:     <feature policy='require' name='vme'/>
Apr 14 12:06:36 user nova-compute[71330]:     <feature policy='require' name='x2apic'/>
Apr 14 12:06:36 user nova-compute[71330]:     <feature policy='require' name='hypervisor'/>
Apr 14 12:06:36 user nova-compute[71330]:   </cpu>
Apr 14 12:06:36 user nova-compute[71330]:   <clock offset='utc'>
Apr 14 12:06:36 user nova-compute[71330]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 12:06:36 user nova-compute[71330]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 12:06:36 user nova-compute[71330]:     <timer name='hpet' present='no'/>
Apr 14 12:06:36 user nova-compute[71330]:   </clock>
Apr 14 12:06:36 user nova-compute[71330]:   <on_poweroff>destroy</on_poweroff>
Apr 14 12:06:36 user nova-compute[71330]:   <on_reboot>restart</on_reboot>
Apr 14 12:06:36 user nova-compute[71330]:   <on_crash>destroy</on_crash>
Apr 14 12:06:36 user nova-compute[71330]:   <devices>
Apr 14 12:06:36 user nova-compute[71330]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 12:06:36 user nova-compute[71330]:     <disk type='file' device='disk'>
Apr 14 12:06:36 user nova-compute[71330]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 12:06:36 user nova-compute[71330]:       <source file='/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk' index='2'/>
Apr 14 12:06:36 user nova-compute[71330]:       <backingStore type='file' index='3'>
Apr 14 12:06:36 user nova-compute[71330]:         <format type='raw'/>
Apr 14 12:06:36 user nova-compute[71330]:         <source file='/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e'/>
Apr 14 12:06:36 user nova-compute[71330]:         <backingStore/>
Apr 14 12:06:36 user nova-compute[71330]:       </backingStore>
Apr 14 12:06:36 user nova-compute[71330]:       <target dev='vda' bus='virtio'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='virtio-disk0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </disk>
Apr 14 12:06:36 user nova-compute[71330]:     <disk type='file' device='cdrom'>
Apr 14 12:06:36 user nova-compute[71330]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 12:06:36 user nova-compute[71330]:       <source file='/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk.config' index='1'/>
Apr 14 12:06:36 user nova-compute[71330]:       <backingStore/>
Apr 14 12:06:36 user nova-compute[71330]:       <target dev='hda' bus='ide'/>
Apr 14 12:06:36 user nova-compute[71330]:       <readonly/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='ide0-0-0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </disk>
Apr 14 12:06:36 user nova-compute[71330]:     <controller type='usb' index='0' model='none'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='usb'/>
Apr 14 12:06:36 user nova-compute[71330]:     </controller>
Apr 14 12:06:36 user nova-compute[71330]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='pci.0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </controller>
Apr 14 12:06:36 user nova-compute[71330]:     <controller type='ide' index='0'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='ide'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 12:06:36 user nova-compute[71330]:     </controller>
Apr 14 12:06:36 user nova-compute[71330]:     <interface type='ethernet'>
Apr 14 12:06:36 user nova-compute[71330]:       <mac address='fa:16:3e:cb:97:28'/>
Apr 14 12:06:36 user nova-compute[71330]:       <target dev='tap4eea14b0-9a'/>
Apr 14 12:06:36 user nova-compute[71330]:       <model type='virtio'/>
Apr 14 12:06:36 user nova-compute[71330]:       <mtu size='1442'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='net0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </interface>
Apr 14 12:06:36 user nova-compute[71330]:     <interface type='ethernet'>
Apr 14 12:06:36 user nova-compute[71330]:       <mac address='fa:16:3e:59:16:01'/>
Apr 14 12:06:36 user nova-compute[71330]:       <target dev='tap2c916396-33'/>
Apr 14 12:06:36 user nova-compute[71330]:       <model type='virtio'/>
Apr 14 12:06:36 user nova-compute[71330]:       <mtu size='1442'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='net1'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </interface>
Apr 14 12:06:36 user nova-compute[71330]:     <serial type='pty'>
Apr 14 12:06:36 user nova-compute[71330]:       <source path='/dev/pts/6'/>
Apr 14 12:06:36 user nova-compute[71330]:       <log file='/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/console.log' append='off'/>
Apr 14 12:06:36 user nova-compute[71330]:       <target type='isa-serial' port='0'>
Apr 14 12:06:36 user nova-compute[71330]:         <model name='isa-serial'/>
Apr 14 12:06:36 user nova-compute[71330]:       </target>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='serial0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </serial>
Apr 14 12:06:36 user nova-compute[71330]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 12:06:36 user nova-compute[71330]:       <source path='/dev/pts/6'/>
Apr 14 12:06:36 user nova-compute[71330]:       <log file='/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/console.log' append='off'/>
Apr 14 12:06:36 user nova-compute[71330]:       <target type='serial' port='0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='serial0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </console>
Apr 14 12:06:36 user nova-compute[71330]:     <input type='mouse' bus='ps2'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='input0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </input>
Apr 14 12:06:36 user nova-compute[71330]:     <input type='keyboard' bus='ps2'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='input1'/>
Apr 14 12:06:36 user nova-compute[71330]:     </input>
Apr 14 12:06:36 user nova-compute[71330]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 14 12:06:36 user nova-compute[71330]:       <listen type='address' address='0.0.0.0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </graphics>
Apr 14 12:06:36 user nova-compute[71330]:     <audio id='1' type='none'/>
Apr 14 12:06:36 user nova-compute[71330]:     <video>
Apr 14 12:06:36 user nova-compute[71330]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='video0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </video>
Apr 14 12:06:36 user nova-compute[71330]:     <memballoon model='virtio'>
Apr 14 12:06:36 user nova-compute[71330]:       <stats period='10'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='balloon0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </memballoon>
Apr 14 12:06:36 user nova-compute[71330]:     <rng model='virtio'>
Apr 14 12:06:36 user nova-compute[71330]:       <backend model='random'>/dev/urandom</backend>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='rng0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </rng>
Apr 14 12:06:36 user nova-compute[71330]:   </devices>
Apr 14 12:06:36 user nova-compute[71330]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 12:06:36 user nova-compute[71330]:     <label>libvirt-8f409eb4-2ec5-4481-9cef-5524ec2ae58b</label>
Apr 14 12:06:36 user nova-compute[71330]:     <imagelabel>libvirt-8f409eb4-2ec5-4481-9cef-5524ec2ae58b</imagelabel>
Apr 14 12:06:36 user nova-compute[71330]:   </seclabel>
Apr 14 12:06:36 user nova-compute[71330]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 12:06:36 user nova-compute[71330]:     <label>+64055:+108</label>
Apr 14 12:06:36 user nova-compute[71330]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 12:06:36 user nova-compute[71330]:   </seclabel>
Apr 14 12:06:36 user nova-compute[71330]: </domain>
Apr 14 12:06:36 user nova-compute[71330]:  {{(pid=71330) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 12:06:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Successfully detached device tap2c916396-33 from instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b from the persistent domain config.
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] (1/8): Attempting to detach device tap2c916396-33 with device alias net1 from instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] detach device xml: <interface type="ethernet">
Apr 14 12:06:36 user nova-compute[71330]:   <mac address="fa:16:3e:59:16:01"/>
Apr 14 12:06:36 user nova-compute[71330]:   <model type="virtio"/>
Apr 14 12:06:36 user nova-compute[71330]:   <mtu size="1442"/>
Apr 14 12:06:36 user nova-compute[71330]:   <target dev="tap2c916396-33"/>
Apr 14 12:06:36 user nova-compute[71330]: </interface>
Apr 14 12:06:36 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681473996.9339993, 8f409eb4-2ec5-4481-9cef-5524ec2ae58b => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Start waiting for the detach event from libvirt for device tap2c916396-33 with device alias net1 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:59:16:01"/><model type="virtio"/><mtu size="1442"/><target dev="tap2c916396-33"/></interface> {{(pid=71330) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:59:16:01"/><model type="virtio"/><mtu size="1442"/><target dev="tap2c916396-33"/></interface>not found in domain: <domain type='kvm' id='29'>
Apr 14 12:06:36 user nova-compute[71330]:   <name>instance-00000015</name>
Apr 14 12:06:36 user nova-compute[71330]:   <uuid>8f409eb4-2ec5-4481-9cef-5524ec2ae58b</uuid>
Apr 14 12:06:36 user nova-compute[71330]:   <metadata>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:06:36 user nova-compute[71330]:   <nova:package version="0.0.0"/>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:name>tempest-device-tagging-server-768440337</nova:name>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:creationTime>2023-04-14 12:06:25</nova:creationTime>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:flavor name="m1.nano">
Apr 14 12:06:36 user nova-compute[71330]:     <nova:memory>128</nova:memory>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:disk>1</nova:disk>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:swap>0</nova:swap>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:vcpus>1</nova:vcpus>
Apr 14 12:06:36 user nova-compute[71330]:   </nova:flavor>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:owner>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:user uuid="e6bb5d52609d47e38856a32e3b847bc6">tempest-TaggedAttachmentsTest-1431365023-project-member</nova:user>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:project uuid="a1020d6403b140d7bd28467afcabf8ae">tempest-TaggedAttachmentsTest-1431365023</nova:project>
Apr 14 12:06:36 user nova-compute[71330]:   </nova:owner>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:ports>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:port uuid="4eea14b0-9a05-4eb6-a383-586a5eeb0622">
Apr 14 12:06:36 user nova-compute[71330]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 12:06:36 user nova-compute[71330]:     </nova:port>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:port uuid="2c916396-3333-46ee-bd7f-3476c2980e51">
Apr 14 12:06:36 user nova-compute[71330]:       <nova:ip type="fixed" address="10.10.10.90" ipVersion="4"/>
Apr 14 12:06:36 user nova-compute[71330]:     </nova:port>
Apr 14 12:06:36 user nova-compute[71330]:   </nova:ports>
Apr 14 12:06:36 user nova-compute[71330]: </nova:instance>
Apr 14 12:06:36 user nova-compute[71330]:   </metadata>
Apr 14 12:06:36 user nova-compute[71330]:   <memory unit='KiB'>131072</memory>
Apr 14 12:06:36 user nova-compute[71330]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 12:06:36 user nova-compute[71330]:   <vcpu placement='static'>1</vcpu>
Apr 14 12:06:36 user nova-compute[71330]:   <resource>
Apr 14 12:06:36 user nova-compute[71330]:     <partition>/machine</partition>
Apr 14 12:06:36 user nova-compute[71330]:   </resource>
Apr 14 12:06:36 user nova-compute[71330]:   <sysinfo type='smbios'>
Apr 14 12:06:36 user nova-compute[71330]:     <system>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='version'>0.0.0</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='serial'>8f409eb4-2ec5-4481-9cef-5524ec2ae58b</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='uuid'>8f409eb4-2ec5-4481-9cef-5524ec2ae58b</entry>
Apr 14 12:06:36 user nova-compute[71330]:       <entry name='family'>Virtual Machine</entry>
Apr 14 12:06:36 user nova-compute[71330]:     </system>
Apr 14 12:06:36 user nova-compute[71330]:   </sysinfo>
Apr 14 12:06:36 user nova-compute[71330]:   <os>
Apr 14 12:06:36 user nova-compute[71330]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 12:06:36 user nova-compute[71330]:     <boot dev='hd'/>
Apr 14 12:06:36 user nova-compute[71330]:     <smbios mode='sysinfo'/>
Apr 14 12:06:36 user nova-compute[71330]:   </os>
Apr 14 12:06:36 user nova-compute[71330]:   <features>
Apr 14 12:06:36 user nova-compute[71330]:     <acpi/>
Apr 14 12:06:36 user nova-compute[71330]:     <apic/>
Apr 14 12:06:36 user nova-compute[71330]:     <vmcoreinfo state='on'/>
Apr 14 12:06:36 user nova-compute[71330]:   </features>
Apr 14 12:06:36 user nova-compute[71330]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 12:06:36 user nova-compute[71330]:     <model fallback='forbid'>Nehalem</model>
Apr 14 12:06:36 user nova-compute[71330]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 12:06:36 user nova-compute[71330]:     <feature policy='require' name='vme'/>
Apr 14 12:06:36 user nova-compute[71330]:     <feature policy='require' name='x2apic'/>
Apr 14 12:06:36 user nova-compute[71330]:     <feature policy='require' name='hypervisor'/>
Apr 14 12:06:36 user nova-compute[71330]:   </cpu>
Apr 14 12:06:36 user nova-compute[71330]:   <clock offset='utc'>
Apr 14 12:06:36 user nova-compute[71330]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 12:06:36 user nova-compute[71330]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 12:06:36 user nova-compute[71330]:     <timer name='hpet' present='no'/>
Apr 14 12:06:36 user nova-compute[71330]:   </clock>
Apr 14 12:06:36 user nova-compute[71330]:   <on_poweroff>destroy</on_poweroff>
Apr 14 12:06:36 user nova-compute[71330]:   <on_reboot>restart</on_reboot>
Apr 14 12:06:36 user nova-compute[71330]:   <on_crash>destroy</on_crash>
Apr 14 12:06:36 user nova-compute[71330]:   <devices>
Apr 14 12:06:36 user nova-compute[71330]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 12:06:36 user nova-compute[71330]:     <disk type='file' device='disk'>
Apr 14 12:06:36 user nova-compute[71330]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 12:06:36 user nova-compute[71330]:       <source file='/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk' index='2'/>
Apr 14 12:06:36 user nova-compute[71330]:       <backingStore type='file' index='3'>
Apr 14 12:06:36 user nova-compute[71330]:         <format type='raw'/>
Apr 14 12:06:36 user nova-compute[71330]:         <source file='/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e'/>
Apr 14 12:06:36 user nova-compute[71330]:         <backingStore/>
Apr 14 12:06:36 user nova-compute[71330]:       </backingStore>
Apr 14 12:06:36 user nova-compute[71330]:       <target dev='vda' bus='virtio'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='virtio-disk0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </disk>
Apr 14 12:06:36 user nova-compute[71330]:     <disk type='file' device='cdrom'>
Apr 14 12:06:36 user nova-compute[71330]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 12:06:36 user nova-compute[71330]:       <source file='/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk.config' index='1'/>
Apr 14 12:06:36 user nova-compute[71330]:       <backingStore/>
Apr 14 12:06:36 user nova-compute[71330]:       <target dev='hda' bus='ide'/>
Apr 14 12:06:36 user nova-compute[71330]:       <readonly/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='ide0-0-0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </disk>
Apr 14 12:06:36 user nova-compute[71330]:     <controller type='usb' index='0' model='none'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='usb'/>
Apr 14 12:06:36 user nova-compute[71330]:     </controller>
Apr 14 12:06:36 user nova-compute[71330]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='pci.0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </controller>
Apr 14 12:06:36 user nova-compute[71330]:     <controller type='ide' index='0'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='ide'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 12:06:36 user nova-compute[71330]:     </controller>
Apr 14 12:06:36 user nova-compute[71330]:     <interface type='ethernet'>
Apr 14 12:06:36 user nova-compute[71330]:       <mac address='fa:16:3e:cb:97:28'/>
Apr 14 12:06:36 user nova-compute[71330]:       <target dev='tap4eea14b0-9a'/>
Apr 14 12:06:36 user nova-compute[71330]:       <model type='virtio'/>
Apr 14 12:06:36 user nova-compute[71330]:       <mtu size='1442'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='net0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </interface>
Apr 14 12:06:36 user nova-compute[71330]:     <serial type='pty'>
Apr 14 12:06:36 user nova-compute[71330]:       <source path='/dev/pts/6'/>
Apr 14 12:06:36 user nova-compute[71330]:       <log file='/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/console.log' append='off'/>
Apr 14 12:06:36 user nova-compute[71330]:       <target type='isa-serial' port='0'>
Apr 14 12:06:36 user nova-compute[71330]:         <model name='isa-serial'/>
Apr 14 12:06:36 user nova-compute[71330]:       </target>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='serial0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </serial>
Apr 14 12:06:36 user nova-compute[71330]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 12:06:36 user nova-compute[71330]:       <source path='/dev/pts/6'/>
Apr 14 12:06:36 user nova-compute[71330]:       <log file='/opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/console.log' append='off'/>
Apr 14 12:06:36 user nova-compute[71330]:       <target type='serial' port='0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='serial0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </console>
Apr 14 12:06:36 user nova-compute[71330]:     <input type='mouse' bus='ps2'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='input0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </input>
Apr 14 12:06:36 user nova-compute[71330]:     <input type='keyboard' bus='ps2'>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='input1'/>
Apr 14 12:06:36 user nova-compute[71330]:     </input>
Apr 14 12:06:36 user nova-compute[71330]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 14 12:06:36 user nova-compute[71330]:       <listen type='address' address='0.0.0.0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </graphics>
Apr 14 12:06:36 user nova-compute[71330]:     <audio id='1' type='none'/>
Apr 14 12:06:36 user nova-compute[71330]:     <video>
Apr 14 12:06:36 user nova-compute[71330]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='video0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </video>
Apr 14 12:06:36 user nova-compute[71330]:     <memballoon model='virtio'>
Apr 14 12:06:36 user nova-compute[71330]:       <stats period='10'/>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='balloon0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </memballoon>
Apr 14 12:06:36 user nova-compute[71330]:     <rng model='virtio'>
Apr 14 12:06:36 user nova-compute[71330]:       <backend model='random'>/dev/urandom</backend>
Apr 14 12:06:36 user nova-compute[71330]:       <alias name='rng0'/>
Apr 14 12:06:36 user nova-compute[71330]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 12:06:36 user nova-compute[71330]:     </rng>
Apr 14 12:06:36 user nova-compute[71330]:   </devices>
Apr 14 12:06:36 user nova-compute[71330]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 12:06:36 user nova-compute[71330]:     <label>libvirt-8f409eb4-2ec5-4481-9cef-5524ec2ae58b</label>
Apr 14 12:06:36 user nova-compute[71330]:     <imagelabel>libvirt-8f409eb4-2ec5-4481-9cef-5524ec2ae58b</imagelabel>
Apr 14 12:06:36 user nova-compute[71330]:   </seclabel>
Apr 14 12:06:36 user nova-compute[71330]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 12:06:36 user nova-compute[71330]:     <label>+64055:+108</label>
Apr 14 12:06:36 user nova-compute[71330]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 12:06:36 user nova-compute[71330]:   </seclabel>
Apr 14 12:06:36 user nova-compute[71330]: </domain>
Apr 14 12:06:36 user nova-compute[71330]:  {{(pid=71330) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 12:06:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Successfully detached device tap2c916396-33 from instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b from the live domain config.
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T12:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-768440337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-768440337',id=21,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwvNK99UVRoZeGKk1C2aKDber+NGXwjSb1OF7CVugl+yUKmkGvJI0M5s8sT36aK2k1pNTrMWaY3J39RsxSA0phyvF4PsH3ppSI9HKHL4P2z4EBsY+MbMNsbgNVmcGY86Q==',key_name='tempest-keypair-1300651092',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1020d6403b140d7bd28467afcabf8ae',ramdisk_id='',reservation_id='r-fc4zikbk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431365023',owner_user_name='tempest-TaggedAttachmentsTest-1431365023-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6bb5d52609d47e38856a32e3b847bc6',uuid=8f409eb4-2ec5-4481-9cef-5524ec2ae58b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converting VIF {"id": "2c916396-3333-46ee-bd7f-3476c2980e51", "address": "fa:16:3e:59:16:01", "network": {"id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-997208708", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c916396-33", "ovs_interfaceid": "2c916396-3333-46ee-bd7f-3476c2980e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:16:01,bridge_name='br-int',has_traffic_filtering=True,id=2c916396-3333-46ee-bd7f-3476c2980e51,network=Network(47a303ab-2823-4049-89ed-7ceeb77b4162),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c916396-33') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG os_vif [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:16:01,bridge_name='br-int',has_traffic_filtering=True,id=2c916396-3333-46ee-bd7f-3476c2980e51,network=Network(47a303ab-2823-4049-89ed-7ceeb77b4162),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c916396-33') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c916396-33, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:06:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:36 user nova-compute[71330]: INFO os_vif [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:16:01,bridge_name='br-int',has_traffic_filtering=True,id=2c916396-3333-46ee-bd7f-3476c2980e51,network=Network(47a303ab-2823-4049-89ed-7ceeb77b4162),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c916396-33')
Apr 14 12:06:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:06:36 user nova-compute[71330]:   <nova:package version="0.0.0"/>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:name>tempest-device-tagging-server-768440337</nova:name>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:creationTime>2023-04-14 12:06:36</nova:creationTime>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:flavor name="m1.nano">
Apr 14 12:06:36 user nova-compute[71330]:     <nova:memory>128</nova:memory>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:disk>1</nova:disk>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:swap>0</nova:swap>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:vcpus>1</nova:vcpus>
Apr 14 12:06:36 user nova-compute[71330]:   </nova:flavor>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:owner>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:user uuid="e6bb5d52609d47e38856a32e3b847bc6">tempest-TaggedAttachmentsTest-1431365023-project-member</nova:user>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:project uuid="a1020d6403b140d7bd28467afcabf8ae">tempest-TaggedAttachmentsTest-1431365023</nova:project>
Apr 14 12:06:36 user nova-compute[71330]:   </nova:owner>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:06:36 user nova-compute[71330]:   <nova:ports>
Apr 14 12:06:36 user nova-compute[71330]:     <nova:port uuid="4eea14b0-9a05-4eb6-a383-586a5eeb0622">
Apr 14 12:06:36 user nova-compute[71330]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 12:06:36 user nova-compute[71330]:     </nova:port>
Apr 14 12:06:36 user nova-compute[71330]:   </nova:ports>
Apr 14 12:06:36 user nova-compute[71330]: </nova:instance>
Apr 14 12:06:36 user nova-compute[71330]:  {{(pid=71330) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 12:06:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-unplugged-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] No waiting events found dispatching network-vif-unplugged-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:37 user nova-compute[71330]: WARNING nova.compute.manager [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received unexpected event network-vif-unplugged-2c916396-3333-46ee-bd7f-3476c2980e51 for instance with vm_state active and task_state None.
Apr 14 12:06:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquired lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:37 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:06:38 user nova-compute[71330]: INFO nova.network.neutron [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Port 2c916396-3333-46ee-bd7f-3476c2980e51 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 14 12:06:38 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updating instance_info_cache with network_info: [{"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Releasing lock "refresh_cache-8f409eb4-2ec5-4481-9cef-5524ec2ae58b" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "interface-8f409eb4-2ec5-4481-9cef-5524ec2ae58b-2c916396-3333-46ee-bd7f-3476c2980e51" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.747s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-plugged-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] No waiting events found dispatching network-vif-plugged-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:06:39 user nova-compute[71330]: WARNING nova.compute.manager [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received unexpected event network-vif-plugged-2c916396-3333-46ee-bd7f-3476c2980e51 for instance with vm_state active and task_state None.
Apr 14 12:06:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-deleted-2c916396-3333-46ee-bd7f-3476c2980e51 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:06:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:06:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:06:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:06:48 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:06:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:06:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:52 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:06:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:53 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:06:56 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:06:56 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7439MB free_disk=26.06786346435547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 545be51c-649c-4297-a924-bbb6ecf303dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:06:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:06:57 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:06:57 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:06:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:06:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:06:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-changed-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Refreshing instance network info cache due to event network-changed-4f8abc87-2a83-454a-9a91-eebcf782364e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:07:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] Acquiring lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:07:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] Acquired lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:07:15 user nova-compute[71330]: DEBUG nova.network.neutron [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Refreshing network info cache for port 4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG nova.objects.instance [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'flavor' on Instance uuid b79d8978-9bc5-4a22-98cf-025f949dc1bc {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:16 user nova-compute[71330]: INFO nova.compute.manager [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Attaching volume 35ffe4be-2c3f-4432-a2c9-893e9a1914c2 to /dev/vdb
Apr 14 12:07:16 user nova-compute[71330]: DEBUG os_brick.utils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c935b4c3-652b-4a18-9b9f-51edbb9e7d89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c21bff6-ce12-44b5-a13f-1a2cdee22904]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc16dc-4134-42d6-9ef0-26869691ef59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[992b525d-b951-464f-981d-2bbfab2e4fef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:07:16 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:07:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[06116448-66a9-4288-9dac-43891c16fbaf]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG os_brick.utils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Updating existing volume attachment record: 43c5eb22-8bc9-40f3-9712-5d2cde35947e {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:07:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG nova.network.neutron [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Updated VIF entry in instance network info cache for port 4f8abc87-2a83-454a-9a91-eebcf782364e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG nova.network.neutron [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Updating instance_info_cache with network_info: [{"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] Releasing lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG nova.objects.instance [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'flavor' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:17 user nova-compute[71330]: INFO nova.compute.manager [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Attaching volume 456eefe5-dfcc-43aa-bb82-87ee292ece79 to /dev/vdb
Apr 14 12:07:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-changed-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Refreshing instance network info cache due to event network-changed-3ba9407c-344c-45b8-a483-36e0c0e72ff0. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] Acquiring lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] Acquired lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG nova.network.neutron [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Refreshing network info cache for port 3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG os_brick.utils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[505c5fad-9750-4aad-858e-59acacc5e800]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fbb25d-1221-4340-9653-7de0f70040e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c175eb-1c3b-44a5-9272-30c61a12f8d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ae421-c2ed-4a29-a097-3e3f01827d63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:07:18 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[01adf18f-e1b6-464b-b8e5-3350dc4bdf02]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG os_brick.utils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating existing volume attachment record: e7188c8a-553a-44f7-94ad-4c563fd28cdc {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG nova.network.neutron [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updated VIF entry in instance network info cache for port 3ba9407c-344c-45b8-a483-36e0c0e72ff0. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG nova.network.neutron [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating instance_info_cache with network_info: [{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:07:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] Releasing lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:07:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMrAPLzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:21 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:21 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:21 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d088e2a-9a49-4e8c-bfc2-2ab678cdaa66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:07:21 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b850602-1017-4510-9884-f48fc4aee32f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2] added
Apr 14 12:07:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e595f9cc-64e8-425b-a10a-6bf3395d2aa6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf34403-9dd4-42cf-a4cb-337c28936447]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMrAPLzK {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMrAPLzK" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a93fd6-c1ac-4209-8bd1-b0f36f64fc39]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMrAPLzK'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[354dd4b6-bb93-4fca-9b88-61df173899af]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c42c911-d421-43da-a255-738364960b0d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4974f651-ac81-41cd-a624-b4a1d90a0b20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2, portal: 172.16.0.220,3260]
Apr 14 12:07:21 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2, portal: 172.16.0.220,3260] successful.
Apr 14 12:07:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e066a5-778d-497c-8618-75538b7d319a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[95497bca-0f14-43bf-b230-0343594bb775]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)
Apr 14 12:07:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66b1cfc-56cf-4c51-b900-c74ea909a851]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMrAPLzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:07:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDywtrPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:22 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26431376434646638', 'path': '/dev/sdd'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431376434646638', 'path': '/dev/sdd'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.240s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:22 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:22 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG nova.objects.instance [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'flavor' on Instance uuid b79d8978-9bc5-4a22-98cf-025f949dc1bc {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be3668b-c6dc-4fcc-9f98-0b51b0871118]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:07:22 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:07:22 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:07:22 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:07:22 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:07:22 user nova-compute[71330]:   <serial>35ffe4be-2c3f-4432-a2c9-893e9a1914c2</serial>
Apr 14 12:07:22 user nova-compute[71330]: </disk>
Apr 14 12:07:22 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa97308-3a5b-446b-8155-2e3f4d8def91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79] added
Apr 14 12:07:22 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[daec52bf-3144-4590-bfcd-1e154bceeb43]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.094s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6d86b3-89e3-4990-ba6f-9d7dfb9cc8e3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDywtrPu {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDywtrPu" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c14ff78-d146-485c-8c4c-c72b8210ce48]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SDywtrPu'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e782cf77-e453-4492-b558-322d63ed1367]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0210f0d4-ece7-45c9-9b41-9ed2c5d53086]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d912d14-34d4-4727-bc59-08164b91692e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79, portal: 172.16.0.220,3260]
Apr 14 12:07:23 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79, portal: 172.16.0.220,3260] successful.
Apr 14 12:07:23 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[46184a73-dc17-48a6-bf82-4d46d537044f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1bf126-0f96-48b7-8efe-40b0edb04e81]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:23 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[84738288-9fb2-4956-92a8-560cb1ccacbc]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDywtrPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] No VIF found with MAC fa:16:3e:f7:82:d8, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:07:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.232s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] <== connect_volume: return (1656ms) {'type': 'block', 'scsi_wwn': '23237636139353130', 'path': '/dev/sdf'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237636139353130', 'path': '/dev/sdf'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.objects.instance [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'flavor' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:07:24 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:07:24 user nova-compute[71330]:   <source dev="/dev/sdf"/>
Apr 14 12:07:24 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:07:24 user nova-compute[71330]:   <serial>456eefe5-dfcc-43aa-bb82-87ee292ece79</serial>
Apr 14 12:07:24 user nova-compute[71330]: </disk>
Apr 14 12:07:24 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:24 user nova-compute[71330]: INFO nova.compute.manager [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Detaching volume 35ffe4be-2c3f-4432-a2c9-893e9a1914c2
Apr 14 12:07:24 user nova-compute[71330]: INFO nova.virt.block_device [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Attempting to driver detach volume 35ffe4be-2c3f-4432-a2c9-893e9a1914c2 from mountpoint /dev/vdb
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Attempting to detach device vdb from instance b79d8978-9bc5-4a22-98cf-025f949dc1bc from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:07:24 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:07:24 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:07:24 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:07:24 user nova-compute[71330]:   <serial>35ffe4be-2c3f-4432-a2c9-893e9a1914c2</serial>
Apr 14 12:07:24 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:07:24 user nova-compute[71330]: </disk>
Apr 14 12:07:24 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:07:24 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Successfully detached device vdb from instance b79d8978-9bc5-4a22-98cf-025f949dc1bc from the persistent domain config.
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b79d8978-9bc5-4a22-98cf-025f949dc1bc from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:07:24 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:07:24 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:07:24 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:07:24 user nova-compute[71330]:   <serial>35ffe4be-2c3f-4432-a2c9-893e9a1914c2</serial>
Apr 14 12:07:24 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:07:24 user nova-compute[71330]: </disk>
Apr 14 12:07:24 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No VIF found with MAC fa:16:3e:5e:c2:00, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:07:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.084s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474045.1382818, b79d8978-9bc5-4a22-98cf-025f949dc1bc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:07:25 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Successfully detached device vdb from instance b79d8978-9bc5-4a22-98cf-025f949dc1bc from the live domain config.
Apr 14 12:07:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMrAPLzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:25 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7fcc31-61e4-4cde-9ad2-0114d795c12c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:07:25 user nova-compute[71330]: No targets found.
Apr 14 12:07:25 user nova-compute[71330]: iSNS:
Apr 14 12:07:25 user nova-compute[71330]: No targets found.
Apr 14 12:07:25 user nova-compute[71330]: STATIC:
Apr 14 12:07:25 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c
Apr 14 12:07:25 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:25 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:25 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:07:25 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:25 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:25 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79
Apr 14 12:07:25 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:25 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:25 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2
Apr 14 12:07:25 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:25 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:25 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2
Apr 14 12:07:25 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:25 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:25 user nova-compute[71330]: FIRMWARE:
Apr 14 12:07:25 user nova-compute[71330]: No targets found.
Apr 14 12:07:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:07:25 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:07:25 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdb81e0-36a3-4d06-9f8b-37486f58ba2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7298d17-929f-48be-9691-c55a203dd1e7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:25 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:25 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:25 user nova-compute[71330]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)
Apr 14 12:07:25 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:25 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:25 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:25 user nova-compute[71330]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 (non-flash)
Apr 14 12:07:25 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c2c3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2'): ({'sdd'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Removing single pathed devices sdd {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae7ccb5-6f95-4056-b50d-2c47e069497b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[80abfc38-ecb7-4afa-a679-56c5cb553bc5]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flushing IO for device /dev/sdd {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5e58e3-c641-49f8-88b5-5db1a4ff9369]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c743d789-eb65-4a8e-a80f-a91c7a4ef864]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7c2390-e387-4a59-b0c7-95c88da4a11c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8fb370-aaa3-4b0f-879a-05769b464149]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2, portal: 172.16.0.220,3260]
Apr 14 12:07:25 user nova-compute[71330]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2, portal: 172.16.0.220,3260] successful.
Apr 14 12:07:25 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ffe4be-2c3f-4432-a2c9-893e9a1914c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c7039f-2de3-4137-81a1-44869a251272]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] <== disconnect_volume: return (320ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:07:25 user nova-compute[71330]: INFO nova.compute.manager [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Rescuing
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquired lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:07:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'flavor' on Instance uuid b79d8978-9bc5-4a22-98cf-025f949dc1bc {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.795s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG nova.network.neutron [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating instance_info_cache with network_info: [{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Releasing lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-unplugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG nova.compute.manager [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-unplugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:07:26 user nova-compute[71330]: WARNING nova.compute.manager [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-unplugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state active and task_state rescuing.
Apr 14 12:07:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Instance destroyed successfully.
Apr 14 12:07:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Attempting rescue
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71330) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Instance directory exists: not creating {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 12:07:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Creating image(s)
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.147s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:27 user nova-compute[71330]: INFO nova.compute.manager [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Terminating instance
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue" returned: 0 in 0.058s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'migration_context' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Start _get_guest_xml network_info=[{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "vif_mac": "fa:16:3e:5e:c2:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'resources' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'numa_topology' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:07:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1425077184',display_name='tempest-ServerRescueNegativeTestJSON-server-1425077184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1425077184',id=23,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChwBqnED/n2nWrN2SoLSMRhqkE84LnQSbYpaeWVgLfUiXzTqQT/5YeOR1ydLbZ836JaTZWc0GepItYuqZ/dHFeEKlQx8bHxyYpEaXK0Bnde9kYWx5+wzLpg/aD1Yl4K9A==',key_name='tempest-keypair-1239489635',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:05:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-x76brrrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:05:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=4595c0e6-f2af-47ef-b26e-7b1ccb58aa47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "vif_mac": "fa:16:3e:5e:c2:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "vif_mac": "fa:16:3e:5e:c2:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c2:00,bridge_name='br-int',has_traffic_filtering=True,id=3ba9407c-344c-45b8-a483-36e0c0e72ff0,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9407c-34') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'pci_devices' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:07:27 user nova-compute[71330]:   <uuid>4595c0e6-f2af-47ef-b26e-7b1ccb58aa47</uuid>
Apr 14 12:07:27 user nova-compute[71330]:   <name>instance-00000017</name>
Apr 14 12:07:27 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:07:27 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:07:27 user nova-compute[71330]:   <metadata>
Apr 14 12:07:27 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:07:27 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:07:27 user nova-compute[71330]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1425077184</nova:name>
Apr 14 12:07:27 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:07:27</nova:creationTime>
Apr 14 12:07:27 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:07:27 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:07:27 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:07:27 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:07:27 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:07:27 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:07:27 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:07:27 user nova-compute[71330]:       <nova:owner>
Apr 14 12:07:27 user nova-compute[71330]:         <nova:user uuid="263c47076ee94cfaaa34eff928a36fdd">tempest-ServerRescueNegativeTestJSON-896417797-project-member</nova:user>
Apr 14 12:07:27 user nova-compute[71330]:         <nova:project uuid="f042abdcef8f41488e8f4624c2f4970b">tempest-ServerRescueNegativeTestJSON-896417797</nova:project>
Apr 14 12:07:27 user nova-compute[71330]:       </nova:owner>
Apr 14 12:07:27 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:07:27 user nova-compute[71330]:       <nova:ports>
Apr 14 12:07:27 user nova-compute[71330]:         <nova:port uuid="3ba9407c-344c-45b8-a483-36e0c0e72ff0">
Apr 14 12:07:27 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 12:07:27 user nova-compute[71330]:         </nova:port>
Apr 14 12:07:27 user nova-compute[71330]:       </nova:ports>
Apr 14 12:07:27 user nova-compute[71330]:     </nova:instance>
Apr 14 12:07:27 user nova-compute[71330]:   </metadata>
Apr 14 12:07:27 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:07:27 user nova-compute[71330]:     <system>
Apr 14 12:07:27 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:07:27 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:07:27 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:07:27 user nova-compute[71330]:       <entry name="serial">4595c0e6-f2af-47ef-b26e-7b1ccb58aa47</entry>
Apr 14 12:07:27 user nova-compute[71330]:       <entry name="uuid">4595c0e6-f2af-47ef-b26e-7b1ccb58aa47</entry>
Apr 14 12:07:27 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:07:27 user nova-compute[71330]:     </system>
Apr 14 12:07:27 user nova-compute[71330]:   </sysinfo>
Apr 14 12:07:27 user nova-compute[71330]:   <os>
Apr 14 12:07:27 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:07:27 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:07:27 user nova-compute[71330]:   </os>
Apr 14 12:07:27 user nova-compute[71330]:   <features>
Apr 14 12:07:27 user nova-compute[71330]:     <acpi/>
Apr 14 12:07:27 user nova-compute[71330]:     <apic/>
Apr 14 12:07:27 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:07:27 user nova-compute[71330]:   </features>
Apr 14 12:07:27 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:07:27 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:07:27 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:07:27 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:07:27 user nova-compute[71330]:   </clock>
Apr 14 12:07:27 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:07:27 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:07:27 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:07:27 user nova-compute[71330]:   </cpu>
Apr 14 12:07:27 user nova-compute[71330]:   <devices>
Apr 14 12:07:27 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:07:27 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:07:27 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue"/>
Apr 14 12:07:27 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:07:27 user nova-compute[71330]:     </disk>
Apr 14 12:07:27 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:07:27 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:07:27 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk"/>
Apr 14 12:07:27 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:07:27 user nova-compute[71330]:     </disk>
Apr 14 12:07:27 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:07:27 user nova-compute[71330]:       <mac address="fa:16:3e:5e:c2:00"/>
Apr 14 12:07:27 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:07:27 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:07:27 user nova-compute[71330]:       <target dev="tap3ba9407c-34"/>
Apr 14 12:07:27 user nova-compute[71330]:     </interface>
Apr 14 12:07:27 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:07:27 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/console.log" append="off"/>
Apr 14 12:07:27 user nova-compute[71330]:     </serial>
Apr 14 12:07:27 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:07:27 user nova-compute[71330]:     <video>
Apr 14 12:07:27 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:07:27 user nova-compute[71330]:     </video>
Apr 14 12:07:27 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:07:27 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:07:27 user nova-compute[71330]:     </rng>
Apr 14 12:07:27 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:07:27 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:07:27 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:07:27 user nova-compute[71330]:     </memballoon>
Apr 14 12:07:27 user nova-compute[71330]:   </devices>
Apr 14 12:07:27 user nova-compute[71330]: </domain>
Apr 14 12:07:27 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Instance destroyed successfully.
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:07:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] No VIF found with MAC fa:16:3e:5e:c2:00, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "0da5f24e-8cf1-4318-a4f4-e53c16756510" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:07:28 user nova-compute[71330]: INFO nova.compute.claims [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Claim successful on node user
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:07:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Instance destroyed successfully.
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.objects.instance [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'resources' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T12:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-768440337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-768440337',id=21,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwvNK99UVRoZeGKk1C2aKDber+NGXwjSb1OF7CVugl+yUKmkGvJI0M5s8sT36aK2k1pNTrMWaY3J39RsxSA0phyvF4PsH3ppSI9HKHL4P2z4EBsY+MbMNsbgNVmcGY86Q==',key_name='tempest-keypair-1300651092',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1020d6403b140d7bd28467afcabf8ae',ramdisk_id='',reservation_id='r-fc4zikbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431365023',owner_user_name='tempest-TaggedAttachmentsTest-1431365023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6bb5d52609d47e38856a32e3b847bc6',uuid=8f409eb4-2ec5-4481-9cef-5524ec2ae58b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converting VIF {"id": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "address": "fa:16:3e:cb:97:28", "network": {"id": "e6d019aa-3803-406f-ae9f-ef1909499d79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-761947262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1020d6403b140d7bd28467afcabf8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eea14b0-9a", "ovs_interfaceid": "4eea14b0-9a05-4eb6-a383-586a5eeb0622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:97:28,bridge_name='br-int',has_traffic_filtering=True,id=4eea14b0-9a05-4eb6-a383-586a5eeb0622,network=Network(e6d019aa-3803-406f-ae9f-ef1909499d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eea14b0-9a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG os_vif [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:97:28,bridge_name='br-int',has_traffic_filtering=True,id=4eea14b0-9a05-4eb6-a383-586a5eeb0622,network=Network(e6d019aa-3803-406f-ae9f-ef1909499d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eea14b0-9a') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4eea14b0-9a, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:28 user nova-compute[71330]: INFO os_vif [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:97:28,bridge_name='br-int',has_traffic_filtering=True,id=4eea14b0-9a05-4eb6-a383-586a5eeb0622,network=Network(e6d019aa-3803-406f-ae9f-ef1909499d79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eea14b0-9a')
Apr 14 12:07:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Deleting instance files /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b_del
Apr 14 12:07:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Deletion of /opt/stack/data/nova/instances/8f409eb4-2ec5-4481-9cef-5524ec2ae58b_del complete
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:07:28 user nova-compute[71330]: WARNING nova.compute.manager [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state active and task_state rescuing.
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-unplugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] No waiting events found dispatching network-vif-unplugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-unplugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-plugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Acquiring lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] No waiting events found dispatching network-vif-plugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:07:28 user nova-compute[71330]: WARNING nova.compute.manager [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received unexpected event network-vif-plugged-4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance with vm_state active and task_state deleting.
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:07:28 user nova-compute[71330]: INFO nova.compute.manager [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Took 1.41 seconds to destroy the instance on the hypervisor.
Apr 14 12:07:28 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:07:28 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:07:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:07:29 user nova-compute[71330]: INFO nova.virt.block_device [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Booting with volume snapshot aa09e440-819f-4288-8b93-8a236ed86b53 at /dev/vda
Apr 14 12:07:29 user nova-compute[71330]: DEBUG nova.policy [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:07:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG nova.network.neutron [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Successfully created port: a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:07:30 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Took 1.47 seconds to deallocate network for instance.
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-acf08a4c-d86e-4fad-8f49-ed76b535333a req-40d33056-4421-427a-9bf1-023854d9a336 service nova] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Received event network-vif-deleted-4eea14b0-9a05-4eb6-a383-586a5eeb0622 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:30 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Deleted allocations for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b
Apr 14 12:07:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:07:30 user nova-compute[71330]: WARNING nova.compute.manager [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state active and task_state rescuing.
Apr 14 12:07:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:07:30 user nova-compute[71330]: WARNING nova.compute.manager [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state active and task_state rescuing.
Apr 14 12:07:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "8f409eb4-2ec5-4481-9cef-5524ec2ae58b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.485s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Successfully updated port: a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "refresh_cache-0da5f24e-8cf1-4318-a4f4-e53c16756510" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquired lock "refresh_cache-0da5f24e-8cf1-4318-a4f4-e53c16756510" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Updating instance_info_cache with network_info: [{"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Releasing lock "refresh_cache-0da5f24e-8cf1-4318-a4f4-e53c16756510" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Instance network_info: |[{"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474051.8924408, 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:07:31 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] VM Resumed (Lifecycle Event)
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:07:31 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474051.8941424, 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:07:31 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] VM Started (Lifecycle Event)
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:07:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:07:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received event network-changed-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Refreshing instance network info cache due to event network-changed-a634601e-0b2d-48e8-8777-f6ceec473beb. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:07:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] Acquiring lock "refresh_cache-0da5f24e-8cf1-4318-a4f4-e53c16756510" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:07:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] Acquired lock "refresh_cache-0da5f24e-8cf1-4318-a4f4-e53c16756510" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:07:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Refreshing network info cache for port a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:07:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Updated VIF entry in instance network info cache for port a634601e-0b2d-48e8-8777-f6ceec473beb. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:07:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Updating instance_info_cache with network_info: [{"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:07:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] Releasing lock "refresh_cache-0da5f24e-8cf1-4318-a4f4-e53c16756510" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:07:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG os_brick.utils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8dbe41-7a60-47c8-b6d9-b899775951b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4197a069-9cdb-4e91-abd7-cfa65447c451]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad4befe-78c3-443c-bca2-817ce2bd9e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b24435-4b6d-4b98-bad2-67c019568837]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:07:34 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:07:34 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6ecea-6f2f-40d1-bea8-a12d995dd7b7]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG os_brick.utils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:34 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Updating existing volume attachment record: a1b4758c-5e96-4db1-a34b-f6d7b3726563 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:07:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 12:07:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] There are 0 instances to clean {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 12:07:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:07:39 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Creating image(s)
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Ensure instance console log exists: /opt/stack/data/nova/instances/0da5f24e-8cf1-4318-a4f4-e53c16756510/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Start _get_guest_xml network_info=[{"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'a1b4758c-5e96-4db1-a34b-f6d7b3726563', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBbHLEoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0da5f24e-8cf1-4318-a4f4-e53c16756510', 'attached_at': '', 'detached_at': '', 'volume_id': '8878ec93-6038-4aec-975c-11da89cc817c', 'serial': '8878ec93-6038-4aec-975c-11da89cc817c'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:07:39 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:07:39 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBbHLEoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:39 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:39 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:39 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d527c6f-d2a9-46d0-8872-2d683f57d150]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:07:39 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[820db6f4-ed07-4d74-b8f8-87e98386dfe8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c] added
Apr 14 12:07:39 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5339cdcb-d158-42f4-adb1-e95530d084b5]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66f1210-3b0e-4652-b8fc-71a0e2b4881c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TBbHLEoS {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TBbHLEoS" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[489b3127-20fb-470d-9742-66bdc4fd77e3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TBbHLEoS'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f340af6-5549-4ac3-9509-80d18b2cb4b0]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[76327f15-a4e6-47e9-acd2-be6ef22234ab]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --login" returned: 0 in 0.216s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff06d7-e635-4130-94ad-3e295505acd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c, portal: 172.16.0.220,3260]
Apr 14 12:07:40 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c, portal: 172.16.0.220,3260] successful.
Apr 14 12:07:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b54ac4-33f5-4360-b65f-1d51b4b22d10]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9051e3f-55f4-4b7b-867f-761122b52d56]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:07:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:40 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:07:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[400ac72c-6c53-4703-9037-a681899e4c41]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:07:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBbHLEoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '23165613766653430', 'path': '/dev/sdd'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165613766653430', 'path': '/dev/sdd'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-661642535',display_name='tempest-TestVolumeBootPattern-server-661642535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-661642535',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-gb2849nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:07:29Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=0da5f24e-8cf1-4318-a4f4-e53c16756510,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=a634601e-0b2d-48e8-8777-f6ceec473beb,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa634601e-0b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.objects.instance [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'pci_devices' on Instance uuid 0da5f24e-8cf1-4318-a4f4-e53c16756510 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:07:41 user nova-compute[71330]:   <uuid>0da5f24e-8cf1-4318-a4f4-e53c16756510</uuid>
Apr 14 12:07:41 user nova-compute[71330]:   <name>instance-0000001a</name>
Apr 14 12:07:41 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:07:41 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:07:41 user nova-compute[71330]:   <metadata>
Apr 14 12:07:41 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:07:41 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:07:41 user nova-compute[71330]:       <nova:name>tempest-TestVolumeBootPattern-server-661642535</nova:name>
Apr 14 12:07:41 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:07:39</nova:creationTime>
Apr 14 12:07:41 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:07:41 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:07:41 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:07:41 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:07:41 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:07:41 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:07:41 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:07:41 user nova-compute[71330]:       <nova:owner>
Apr 14 12:07:41 user nova-compute[71330]:         <nova:user uuid="511fd95d993e4837a4a612385b04fdcb">tempest-TestVolumeBootPattern-2042813947-project-member</nova:user>
Apr 14 12:07:41 user nova-compute[71330]:         <nova:project uuid="0c317cb8d6a44115b216678540c433b6">tempest-TestVolumeBootPattern-2042813947</nova:project>
Apr 14 12:07:41 user nova-compute[71330]:       </nova:owner>
Apr 14 12:07:41 user nova-compute[71330]:       <nova:ports>
Apr 14 12:07:41 user nova-compute[71330]:         <nova:port uuid="a634601e-0b2d-48e8-8777-f6ceec473beb">
Apr 14 12:07:41 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 12:07:41 user nova-compute[71330]:         </nova:port>
Apr 14 12:07:41 user nova-compute[71330]:       </nova:ports>
Apr 14 12:07:41 user nova-compute[71330]:     </nova:instance>
Apr 14 12:07:41 user nova-compute[71330]:   </metadata>
Apr 14 12:07:41 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:07:41 user nova-compute[71330]:     <system>
Apr 14 12:07:41 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:07:41 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:07:41 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:07:41 user nova-compute[71330]:       <entry name="serial">0da5f24e-8cf1-4318-a4f4-e53c16756510</entry>
Apr 14 12:07:41 user nova-compute[71330]:       <entry name="uuid">0da5f24e-8cf1-4318-a4f4-e53c16756510</entry>
Apr 14 12:07:41 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:07:41 user nova-compute[71330]:     </system>
Apr 14 12:07:41 user nova-compute[71330]:   </sysinfo>
Apr 14 12:07:41 user nova-compute[71330]:   <os>
Apr 14 12:07:41 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:07:41 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:07:41 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:07:41 user nova-compute[71330]:   </os>
Apr 14 12:07:41 user nova-compute[71330]:   <features>
Apr 14 12:07:41 user nova-compute[71330]:     <acpi/>
Apr 14 12:07:41 user nova-compute[71330]:     <apic/>
Apr 14 12:07:41 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:07:41 user nova-compute[71330]:   </features>
Apr 14 12:07:41 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:07:41 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:07:41 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:07:41 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:07:41 user nova-compute[71330]:   </clock>
Apr 14 12:07:41 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:07:41 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:07:41 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:07:41 user nova-compute[71330]:   </cpu>
Apr 14 12:07:41 user nova-compute[71330]:   <devices>
Apr 14 12:07:41 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:07:41 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:07:41 user nova-compute[71330]:       <source dev="/dev/sdd"/>
Apr 14 12:07:41 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:07:41 user nova-compute[71330]:       <serial>8878ec93-6038-4aec-975c-11da89cc817c</serial>
Apr 14 12:07:41 user nova-compute[71330]:     </disk>
Apr 14 12:07:41 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:07:41 user nova-compute[71330]:       <mac address="fa:16:3e:22:53:9f"/>
Apr 14 12:07:41 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:07:41 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:07:41 user nova-compute[71330]:       <target dev="tapa634601e-0b"/>
Apr 14 12:07:41 user nova-compute[71330]:     </interface>
Apr 14 12:07:41 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:07:41 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/0da5f24e-8cf1-4318-a4f4-e53c16756510/console.log" append="off"/>
Apr 14 12:07:41 user nova-compute[71330]:     </serial>
Apr 14 12:07:41 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:07:41 user nova-compute[71330]:     <video>
Apr 14 12:07:41 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:07:41 user nova-compute[71330]:     </video>
Apr 14 12:07:41 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:07:41 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:07:41 user nova-compute[71330]:     </rng>
Apr 14 12:07:41 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:07:41 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:07:41 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:07:41 user nova-compute[71330]:     </memballoon>
Apr 14 12:07:41 user nova-compute[71330]:   </devices>
Apr 14 12:07:41 user nova-compute[71330]: </domain>
Apr 14 12:07:41 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-661642535',display_name='tempest-TestVolumeBootPattern-server-661642535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-661642535',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-gb2849nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:07:29Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=0da5f24e-8cf1-4318-a4f4-e53c16756510,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=a634601e-0b2d-48e8-8777-f6ceec473beb,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa634601e-0b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG os_vif [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=a634601e-0b2d-48e8-8777-f6ceec473beb,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa634601e-0b') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa634601e-0b, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa634601e-0b, col_values=(('external_ids', {'iface-id': 'a634601e-0b2d-48e8-8777-f6ceec473beb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:53:9f', 'vm-uuid': '0da5f24e-8cf1-4318-a4f4-e53c16756510'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:41 user nova-compute[71330]: INFO os_vif [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=a634601e-0b2d-48e8-8777-f6ceec473beb,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa634601e-0b')
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:07:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No VIF found with MAC fa:16:3e:22:53:9f, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:07:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:43 user nova-compute[71330]: DEBUG nova.compute.manager [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received event network-vif-plugged-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] Acquiring lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:43 user nova-compute[71330]: DEBUG nova.compute.manager [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] No waiting events found dispatching network-vif-plugged-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:07:43 user nova-compute[71330]: WARNING nova.compute.manager [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received unexpected event network-vif-plugged-a634601e-0b2d-48e8-8777-f6ceec473beb for instance with vm_state building and task_state spawning.
Apr 14 12:07:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:43 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474048.8137026, 8f409eb4-2ec5-4481-9cef-5524ec2ae58b => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:07:43 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] VM Stopped (Lifecycle Event)
Apr 14 12:07:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-58794084-5c58-4868-894c-5fbfb930f501 None None] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing instance network info cache due to event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] Acquiring lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] Acquired lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG nova.network.neutron [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:07:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474065.008456, 0da5f24e-8cf1-4318-a4f4-e53c16756510 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:07:45 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] VM Resumed (Lifecycle Event)
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:07:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Instance spawned successfully.
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.compute.manager [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received event network-vif-plugged-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] Acquiring lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.compute.manager [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] No waiting events found dispatching network-vif-plugged-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:07:45 user nova-compute[71330]: WARNING nova.compute.manager [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received unexpected event network-vif-plugged-a634601e-0b2d-48e8-8777-f6ceec473beb for instance with vm_state building and task_state spawning.
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:07:45 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474065.0096266, 0da5f24e-8cf1-4318-a4f4-e53c16756510 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:07:45 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] VM Started (Lifecycle Event)
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:07:45 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:07:45 user nova-compute[71330]: INFO nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.network.neutron [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updated VIF entry in instance network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.network.neutron [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updating instance_info_cache with network_info: [{"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] Releasing lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:07:45 user nova-compute[71330]: INFO nova.compute.manager [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Took 16.87 seconds to build instance.
Apr 14 12:07:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.968s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updating instance_info_cache with network_info: [{"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:45 user nova-compute[71330]: INFO nova.compute.manager [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Detaching volume b62c6d91-1d0e-42a1-ae0e-68e03d7992d2
Apr 14 12:07:46 user nova-compute[71330]: INFO nova.virt.block_device [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Attempting to driver detach volume b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 from mountpoint /dev/vdb
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Attempting to detach device vdb from instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:07:46 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:07:46 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:07:46 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:07:46 user nova-compute[71330]:   <serial>b62c6d91-1d0e-42a1-ae0e-68e03d7992d2</serial>
Apr 14 12:07:46 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:07:46 user nova-compute[71330]: </disk>
Apr 14 12:07:46 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:07:46 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully detached device vdb from instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 from the persistent domain config.
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:07:46 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:07:46 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:07:46 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:07:46 user nova-compute[71330]:   <serial>b62c6d91-1d0e-42a1-ae0e-68e03d7992d2</serial>
Apr 14 12:07:46 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:07:46 user nova-compute[71330]: </disk>
Apr 14 12:07:46 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'flavor' on Instance uuid bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:46 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Ignoring supplied device name: /dev/vdb
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:46 user nova-compute[71330]: INFO nova.compute.manager [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Attaching volume 84a69785-51a3-45bb-b21b-8a2e95aea8bc to /dev/vdb
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.utils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e46621-71cf-4104-a855-abd014df4b5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde6ba4e-b86c-44db-a583-c1c621a1b7e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc764d0-15ec-4f3e-ab43-26511e4d7492]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c4429e-6021-4e86-b5e8-053d175eed75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474066.484468, 075f81e9-8b43-4b05-96be-6eb4cca6d812 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully detached device vdb from instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 from the live domain config.
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUMlQZHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:46 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:07:46 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3c39a2-6255-4f03-a303-625992f4bc36]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.utils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Updating existing volume attachment record: c24962cb-37f5-4167-9165-13006aeaa0bd {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d9c14f-c5a2-433a-a0c3-8ca9f4757d6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:07:46 user nova-compute[71330]: No targets found.
Apr 14 12:07:46 user nova-compute[71330]: iSNS:
Apr 14 12:07:46 user nova-compute[71330]: No targets found.
Apr 14 12:07:46 user nova-compute[71330]: STATIC:
Apr 14 12:07:46 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c
Apr 14 12:07:46 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:46 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:46 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:07:46 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:46 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:46 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79
Apr 14 12:07:46 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:46 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:46 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2
Apr 14 12:07:46 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:46 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:46 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c
Apr 14 12:07:46 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:07:46 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:07:46 user nova-compute[71330]: FIRMWARE:
Apr 14 12:07:46 user nova-compute[71330]: No targets found.
Apr 14 12:07:46 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:07:46 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:07:46 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca5c25-8927-4565-9df5-4cae9f39cd5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cba6767-0bb7-4e18-a31d-051fb82b9e79]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:46 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:46 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:46 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:46 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:07:46 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:46 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:46 user nova-compute[71330]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 (non-flash)
Apr 14 12:07:46 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:46 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:07:46 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c1569e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3020f94-e281-4da7-805c-95570b41461a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0770932-6187-4330-9046-45f5bda20f36]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afddb89-08a8-465f-8dad-77be3eb877b7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94630be-1d64-4d75-aaf6-da3e58063a2c]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ef8825-064a-4836-bcb4-13dbb2a85f3f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6234ea-bf96-4fc6-8318-80c34cf43227]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2, portal: 172.16.0.220,3260]
Apr 14 12:07:46 user nova-compute[71330]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2, portal: 172.16.0.220,3260] successful.
Apr 14 12:07:46 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[be313c6d-7f43-4436-81b1-93dc93ddde23]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] <== disconnect_volume: return (330ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing instance network info cache due to event network-changed-a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] Acquiring lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] Acquired lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG nova.network.neutron [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Refreshing network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG nova.network.neutron [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updated VIF entry in instance network info cache for port a8047706-f64e-47f2-bb99-b1e66dbd2df8. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG nova.network.neutron [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updating instance_info_cache with network_info: [{"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] Releasing lock "refresh_cache-075f81e9-8b43-4b05-96be-6eb4cca6d812" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'flavor' on Instance uuid 075f81e9-8b43-4b05-96be-6eb4cca6d812 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.864s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBASFiCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:07:51 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:51 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:07:51 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[60697e29-2685-40b1-9754-900ae728cd3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:07:51 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef45f5-d648-4c71-967e-cf34ec47a90b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc] added
Apr 14 12:07:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4767e0-827e-4ae9-bf2b-35c8eac250de]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e3de3-4a9b-45b6-a654-0571b3ea8f8c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBASFiCy {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBASFiCy" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a532a0-d775-4196-a1da-9e5bfe02d406]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YBASFiCy'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da844c3-bbaf-44fc-a74a-f92425254b5c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec884a-58e5-4420-aabc-91c6843e567f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:07:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:07:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ebfa2-9390-4ee4-aa15-0951b48b47f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc, portal: 172.16.0.220,3260]
Apr 14 12:07:51 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc, portal: 172.16.0.220,3260] successful.
Apr 14 12:07:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00944f-50bc-4260-b477-55ae84953c2b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5571d28b-b40d-491b-b987-18058b748c5d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc (non-flash)
Apr 14 12:07:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:07:51 user nova-compute[71330]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc (non-flash)
Apr 14 12:07:51 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4215b1fa-0efb-44b5-b06a-b5237aa316da]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBASFiCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:07:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:07:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23466353965353261', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:07:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466353965353261', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:07:52 user nova-compute[71330]: DEBUG nova.objects.instance [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'flavor' on Instance uuid bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:07:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:07:52 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:07:52 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:07:52 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:07:52 user nova-compute[71330]:   <serial>84a69785-51a3-45bb-b21b-8a2e95aea8bc</serial>
Apr 14 12:07:52 user nova-compute[71330]: </disk>
Apr 14 12:07:52 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:07:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:07:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:07:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] No VIF found with MAC fa:16:3e:a0:8a:b3, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:07:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.707s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:07:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:07:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:07:58 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:07:58 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7462MB free_disk=26.055927276611328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 545be51c-649c-4297-a924-bbb6ecf303dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing inventories for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating ProviderTree inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 12:07:58 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing aggregate associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, aggregates: None {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 12:07:59 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing trait associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 12:07:59 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:07:59 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:07:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:07:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.819s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:07:59 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:07:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:01 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances with incomplete migration  {{(pid=71330) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 12:08:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:09 user nova-compute[71330]: INFO nova.compute.manager [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Detaching volume c1aad796-79f6-420f-99ba-c2d1212ece0c
Apr 14 12:08:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:09 user nova-compute[71330]: INFO nova.compute.manager [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Unshelving
Apr 14 12:08:09 user nova-compute[71330]: INFO nova.virt.block_device [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attempting to driver detach volume c1aad796-79f6-420f-99ba-c2d1212ece0c from mountpoint /dev/vdb
Apr 14 12:08:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Attempting to detach device vdb from instance 11e4aa91-7c03-46cc-8610-78f18bbd089f from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:08:09 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:08:09 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:08:09 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:08:09 user nova-compute[71330]:   <serial>c1aad796-79f6-420f-99ba-c2d1212ece0c</serial>
Apr 14 12:08:09 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 12:08:09 user nova-compute[71330]: </disk>
Apr 14 12:08:09 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:08:09 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully detached device vdb from instance 11e4aa91-7c03-46cc-8610-78f18bbd089f from the persistent domain config.
Apr 14 12:08:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11e4aa91-7c03-46cc-8610-78f18bbd089f from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:08:09 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:08:09 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:08:09 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:08:09 user nova-compute[71330]:   <serial>c1aad796-79f6-420f-99ba-c2d1212ece0c</serial>
Apr 14 12:08:09 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 12:08:09 user nova-compute[71330]: </disk>
Apr 14 12:08:09 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG nova.objects.instance [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'pci_requests' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG nova.objects.instance [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'numa_topology' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:09 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:08:09 user nova-compute[71330]: INFO nova.compute.claims [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Claim successful on node user
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:10 user nova-compute[71330]: INFO nova.compute.manager [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Detaching volume 84a69785-51a3-45bb-b21b-8a2e95aea8bc
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474090.3543384, 11e4aa91-7c03-46cc-8610-78f18bbd089f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:08:10 user nova-compute[71330]: INFO nova.virt.block_device [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Attempting to driver detach volume 84a69785-51a3-45bb-b21b-8a2e95aea8bc from mountpoint /dev/vdb
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:08:10 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully detached device vdb from instance 11e4aa91-7c03-46cc-8610-78f18bbd089f from the live domain config.
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfOhsBnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:08:10 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Attempting to detach device vdb from instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:08:10 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:08:10 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:08:10 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:08:10 user nova-compute[71330]:   <serial>84a69785-51a3-45bb-b21b-8a2e95aea8bc</serial>
Apr 14 12:08:10 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:08:10 user nova-compute[71330]: </disk>
Apr 14 12:08:10 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:08:10 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Successfully detached device vdb from instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 from the persistent domain config.
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:08:10 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:08:10 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:08:10 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:08:10 user nova-compute[71330]:   <serial>84a69785-51a3-45bb-b21b-8a2e95aea8bc</serial>
Apr 14 12:08:10 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:08:10 user nova-compute[71330]: </disk>
Apr 14 12:08:10 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfce7be-5d64-4883-9ea0-5827621ecc2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:08:10 user nova-compute[71330]: No targets found.
Apr 14 12:08:10 user nova-compute[71330]: iSNS:
Apr 14 12:08:10 user nova-compute[71330]: No targets found.
Apr 14 12:08:10 user nova-compute[71330]: STATIC:
Apr 14 12:08:10 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c
Apr 14 12:08:10 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:10 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:10 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc
Apr 14 12:08:10 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:10 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:10 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:08:10 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:10 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:10 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79
Apr 14 12:08:10 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:10 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:10 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c
Apr 14 12:08:10 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:10 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:10 user nova-compute[71330]: FIRMWARE:
Apr 14 12:08:10 user nova-compute[71330]: No targets found.
Apr 14 12:08:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:08:10 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:08:10 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd29018-e8ed-4654-9402-8476d0d72bf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5449c60d-1e96-4a9e-9dc0-92d82456538c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc (non-flash)
Apr 14 12:08:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc (non-flash)
Apr 14 12:08:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c157910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f8e54a-89e8-4fc2-a44f-c36a2453b542]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f6eb79-f38a-4d2a-a8fb-02d9cd4997b2]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: INFO nova.network.neutron [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updating port 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9af0b1-45ac-45be-9072-99f232fde32b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf40bd9-cd70-45aa-9cf4-a7cba9db027a]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cc4886-b4ab-44eb-bd3c-f28ba9bd1923]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[80207dea-8f88-4dfd-8a9a-c1f59616f199]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260]
Apr 14 12:08:10 user nova-compute[71330]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c, portal: 172.16.0.220,3260] successful.
Apr 14 12:08:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1aad796-79f6-420f-99ba-c2d1212ece0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[535bc775-dbd0-46e3-a55d-7edde23b63ed]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== disconnect_volume: return (335ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474090.8554902, bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:08:10 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Successfully detached device vdb from instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 from the live domain config.
Apr 14 12:08:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBASFiCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:08:10 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ffb22f-c22d-4f8a-95c1-081550c6ecbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:08:10 user nova-compute[71330]: No targets found.
Apr 14 12:08:10 user nova-compute[71330]: iSNS:
Apr 14 12:08:10 user nova-compute[71330]: No targets found.
Apr 14 12:08:10 user nova-compute[71330]: STATIC:
Apr 14 12:08:10 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc
Apr 14 12:08:10 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:10 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:10 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:08:10 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:10 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:10 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79
Apr 14 12:08:10 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:10 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:10 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c
Apr 14 12:08:10 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:10 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:10 user nova-compute[71330]: FIRMWARE:
Apr 14 12:08:10 user nova-compute[71330]: No targets found.
Apr 14 12:08:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:08:10 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:08:10 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c926b053-60b6-40db-9b5e-f8651dfa8144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd650f15-a235-4eb0-87ee-ee5c22bb8ddc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc (non-flash)
Apr 14 12:08:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:08:10 user nova-compute[71330]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc (non-flash)
Apr 14 12:08:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c1568c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cbb5ef-10da-46cd-8ae2-f1789996db67]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6bfc55-0afa-4faf-9ee5-aac2c1ec40b0]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:08:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9f74b1-147b-49be-9a1e-12f7cdf39701]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b77a852-6e7a-4005-8aab-e2e95954cbb1]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdc558f-4e00-458e-8fea-ded596bec639]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[338dc382-1c42-4004-8716-635038c82445]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc, portal: 172.16.0.220,3260]
Apr 14 12:08:11 user nova-compute[71330]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc, portal: 172.16.0.220,3260] successful.
Apr 14 12:08:11 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a68ffdb-f2db-45fa-a502-880e3321cd07]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] <== disconnect_volume: return (336ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquired lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG nova.network.neutron [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG nova.compute.manager [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-changed-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG nova.compute.manager [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Refreshing instance network info cache due to event network-changed-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] Acquiring lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG nova.network.neutron [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updating instance_info_cache with network_info: [{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'flavor' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Releasing lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:08:11 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Creating image(s)
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG nova.objects.instance [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] Acquired lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG nova.network.neutron [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Refreshing network info cache for port 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "88a9e9186f19d16a0cd74ec9537f2b852e07b2bc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "88a9e9186f19d16a0cd74ec9537f2b852e07b2bc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.981s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG nova.objects.instance [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'flavor' on Instance uuid bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.483s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.372s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:12 user nova-compute[71330]: INFO nova.compute.manager [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Terminating instance
Apr 14 12:08:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc.part --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG nova.virt.images [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] a1c2deb6-1fbe-4cd0-8501-169df29549e1 was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc.part /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.network.neutron [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updated VIF entry in instance network info cache for port 923fca3f-14a0-481e-8c0c-6cb7cc7a04bb. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.network.neutron [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updating instance_info_cache with network_info: [{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-unplugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] No waiting events found dispatching network-vif-unplugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-unplugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc.part /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc.converted" returned: 0 in 0.637s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] Releasing lock "refresh_cache-5181aed1-2933-4b33-893e-eb30a0d4ff4c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:13 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Instance destroyed successfully.
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.objects.instance [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'resources' on Instance uuid bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1254198979',display_name='tempest-VolumesSnapshotTestJSON-instance-1254198979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1254198979',id=24,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae5ac6388692423b9bf23bf6be0cb06d',ramdisk_id='',reservation_id='r-78baruou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1634639087',owner_user_name='tempest-VolumesSnapshotTestJSON-1634639087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:06:03Z,user_data=None,user_id='61adadbd79ef493889ef3dcb63f63fd8',uuid=bf72b2ec-5763-47e9-b9a8-b0cf9df9d649,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converting VIF {"id": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "address": "fa:16:3e:a0:8a:b3", "network": {"id": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1811402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae5ac6388692423b9bf23bf6be0cb06d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1bec16-15", "ovs_interfaceid": "2f1bec16-15b5-414a-aeb9-19c6e8694096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=2f1bec16-15b5-414a-aeb9-19c6e8694096,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1bec16-15') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_vif [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=2f1bec16-15b5-414a-aeb9-19c6e8694096,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1bec16-15') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f1bec16-15, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:08:13 user nova-compute[71330]: INFO os_vif [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:8a:b3,bridge_name='br-int',has_traffic_filtering=True,id=2f1bec16-15b5-414a-aeb9-19c6e8694096,network=Network(c4fb3dc6-20fb-4fce-ac17-7c676652dfe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1bec16-15')
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBASFiCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:08:13 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "88a9e9186f19d16a0cd74ec9537f2b852e07b2bc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.891s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f038dd-d35a-4063-acf8-06e151c65133]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:08:13 user nova-compute[71330]: No targets found.
Apr 14 12:08:13 user nova-compute[71330]: iSNS:
Apr 14 12:08:13 user nova-compute[71330]: No targets found.
Apr 14 12:08:13 user nova-compute[71330]: STATIC:
Apr 14 12:08:13 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:08:13 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:13 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:13 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79
Apr 14 12:08:13 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:13 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:13 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c
Apr 14 12:08:13 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:08:13 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:08:13 user nova-compute[71330]: FIRMWARE:
Apr 14 12:08:13 user nova-compute[71330]: No targets found.
Apr 14 12:08:13 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:08:13 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:08:13 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a69785-51a3-45bb-b21b-8a2e95aea8bc', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abe7d1a-3804-48fc-b767-abd5948848a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0538e0f-12e3-4472-a38a-27c03d8ec788]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:08:13 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:08:13 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:08:13 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:08:13 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:08:13 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:08:13 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c1dd750>, {}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Disconnecting from: [] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.101s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] <== disconnect_volume: return (103ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:08:13 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Deleting instance files /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649_del
Apr 14 12:08:13 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Deletion of /opt/stack/data/nova/instances/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649_del complete
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "88a9e9186f19d16a0cd74ec9537f2b852e07b2bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "88a9e9186f19d16a0cd74ec9537f2b852e07b2bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:13 user nova-compute[71330]: INFO nova.compute.manager [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Took 1.03 seconds to destroy the instance on the hypervisor.
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc --force-share --output=json" returned: 0 in 0.159s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc,backing_fmt=raw /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc,backing_fmt=raw /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk 1073741824" returned: 0 in 0.051s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "88a9e9186f19d16a0cd74ec9537f2b852e07b2bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:14 user nova-compute[71330]: DEBUG nova.objects.instance [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'migration_context' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:14 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Rebasing disk image.
Apr 14 12:08:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e -F raw /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:14 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:08:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-deleted-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:14 user nova-compute[71330]: INFO nova.compute.manager [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Neutron deleted interface 2f1bec16-15b5-414a-aeb9-19c6e8694096; detaching it from the instance and deleting it from the info cache
Apr 14 12:08:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:08:14 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Took 0.84 seconds to deallocate network for instance.
Apr 14 12:08:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Detach interface failed, port_id=2f1bec16-15b5-414a-aeb9-19c6e8694096, reason: Instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:08:14 user nova-compute[71330]: WARNING nova.volume.cinder [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Attachment c24962cb-37f5-4167-9165-13006aeaa0bd does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c24962cb-37f5-4167-9165-13006aeaa0bd. (HTTP 404) (Request-ID: req-8fb33b04-692b-4209-8604-4e1422ff5ea9)
Apr 14 12:08:14 user nova-compute[71330]: INFO nova.compute.manager [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 12:08:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] No waiting events found dispatching network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:15 user nova-compute[71330]: WARNING nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received unexpected event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance with vm_state deleted and task_state None.
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] No waiting events found dispatching network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:15 user nova-compute[71330]: WARNING nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received unexpected event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance with vm_state deleted and task_state None.
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] No waiting events found dispatching network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:15 user nova-compute[71330]: WARNING nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received unexpected event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance with vm_state deleted and task_state None.
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-unplugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] No waiting events found dispatching network-vif-unplugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:15 user nova-compute[71330]: WARNING nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received unexpected event network-vif-unplugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance with vm_state deleted and task_state None.
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Acquiring lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] No waiting events found dispatching network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:15 user nova-compute[71330]: WARNING nova.compute.manager [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Received unexpected event network-vif-plugged-2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance with vm_state deleted and task_state None.
Apr 14 12:08:15 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Deleted allocations for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.146s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-changed-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Refreshing instance network info cache due to event network-changed-4f8abc87-2a83-454a-9a91-eebcf782364e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] Acquiring lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] Acquired lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.network.neutron [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Refreshing network info cache for port 4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:15 user nova-compute[71330]: INFO nova.compute.manager [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Terminating instance
Apr 14 12:08:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.network.neutron [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Updated VIF entry in instance network info cache for port 4f8abc87-2a83-454a-9a91-eebcf782364e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.network.neutron [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Updating instance_info_cache with network_info: [{"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] Releasing lock "refresh_cache-b79d8978-9bc5-4a22-98cf-025f949dc1bc" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Instance destroyed successfully.
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.objects.instance [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'resources' on Instance uuid b79d8978-9bc5-4a22-98cf-025f949dc1bc {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1674782637',display_name='tempest-TestStampPattern-server-1674782637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1674782637',id=22,image_ref='98eae243-e785-4a84-b3a6-939da193871d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcWumXfNSjLDovtKNaUkPPvNJyQGmlmWEq5lmR1ljchHoI3F3BUNa7dKibvc69DYc5cYCD1AWmxfaa3wcxsCbua+WlZRoR5F/ExK2Ac04hcBu8nxWqQ13C+9/nYhnqwIg==',key_name='tempest-TestStampPattern-1794429979',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:05:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfb2ac7942e1473f88b05de5aa79a3ee',ramdisk_id='',reservation_id='r-o7qb5gtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ba2689ad-6a47-45c2-b5db-bec9e5a152ac',image_min_disk='1',image_min_ram='0',image_owner_id='cfb2ac7942e1473f88b05de5aa79a3ee',image_owner_project_name='tempest-TestStampPattern-1032317746',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1032317746-project-member',image_user_id='e2b8b516910f41ffbb8bbf5f9e3c2ec8',owner_project_name='tempest-TestStampPattern-1032317746',owner_user_name='tempest-TestStampPattern-1032317746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:05:35Z,user_data=None,user_id='e2b8b516910f41ffbb8bbf5f9e3c2ec8',uuid=b79d8978-9bc5-4a22-98cf-025f949dc1bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converting VIF {"id": "4f8abc87-2a83-454a-9a91-eebcf782364e", "address": "fa:16:3e:f7:82:d8", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8abc87-2a", "ovs_interfaceid": "4f8abc87-2a83-454a-9a91-eebcf782364e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:82:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f8abc87-2a83-454a-9a91-eebcf782364e,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8abc87-2a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG os_vif [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:82:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f8abc87-2a83-454a-9a91-eebcf782364e,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8abc87-2a') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f8abc87-2a, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e -F raw /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk" returned: 0 in 2.533s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Ensure instance console log exists: /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Start _get_guest_xml network_info=[{"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9fe2be524e03d8e88072a190b36fd239',container_format='bare',created_at=2023-04-14T12:06:17Z,direct_url=<?>,disk_format='qcow2',id=a1c2deb6-1fbe-4cd0-8501-169df29549e1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-549197077-shelved',owner='cc13fb093d2745e8ba0152533140b6f2',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T12:06:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:08:16 user nova-compute[71330]: INFO os_vif [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:82:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f8abc87-2a83-454a-9a91-eebcf782364e,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8abc87-2a')
Apr 14 12:08:16 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Deleting instance files /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc_del
Apr 14 12:08:16 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Deletion of /opt/stack/data/nova/instances/b79d8978-9bc5-4a22-98cf-025f949dc1bc_del complete
Apr 14 12:08:16 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:08:16 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9fe2be524e03d8e88072a190b36fd239',container_format='bare',created_at=2023-04-14T12:06:17Z,direct_url=<?>,disk_format='qcow2',id=a1c2deb6-1fbe-4cd0-8501-169df29549e1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-549197077-shelved',owner='cc13fb093d2745e8ba0152533140b6f2',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T12:06:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.objects.instance [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-549197077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-549197077',id=20,image_ref='a1c2deb6-1fbe-4cd0-8501-169df29549e1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-230816513',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:04:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-q4keusmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member',shelved_at='2023-04-14T12:06:20.969478',shelved_host='user',shelved_image_id='a1c2deb6-1fbe-4cd0-8501-169df29549e1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:08:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=5181aed1-2933-4b33-893e-eb30a0d4ff4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.objects.instance [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'pci_devices' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:08:16 user nova-compute[71330]:   <uuid>5181aed1-2933-4b33-893e-eb30a0d4ff4c</uuid>
Apr 14 12:08:16 user nova-compute[71330]:   <name>instance-00000014</name>
Apr 14 12:08:16 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:08:16 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:08:16 user nova-compute[71330]:   <metadata>
Apr 14 12:08:16 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:08:16 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:08:16 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-549197077</nova:name>
Apr 14 12:08:16 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:08:16</nova:creationTime>
Apr 14 12:08:16 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:08:16 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:08:16 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:08:16 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:08:16 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:08:16 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:08:16 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:08:16 user nova-compute[71330]:       <nova:owner>
Apr 14 12:08:16 user nova-compute[71330]:         <nova:user uuid="260d1d4ef5a1422f84f9d91224b53952">tempest-AttachVolumeShelveTestJSON-1457966394-project-member</nova:user>
Apr 14 12:08:16 user nova-compute[71330]:         <nova:project uuid="cc13fb093d2745e8ba0152533140b6f2">tempest-AttachVolumeShelveTestJSON-1457966394</nova:project>
Apr 14 12:08:16 user nova-compute[71330]:       </nova:owner>
Apr 14 12:08:16 user nova-compute[71330]:       <nova:root type="image" uuid="a1c2deb6-1fbe-4cd0-8501-169df29549e1"/>
Apr 14 12:08:16 user nova-compute[71330]:       <nova:ports>
Apr 14 12:08:16 user nova-compute[71330]:         <nova:port uuid="923fca3f-14a0-481e-8c0c-6cb7cc7a04bb">
Apr 14 12:08:16 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 12:08:16 user nova-compute[71330]:         </nova:port>
Apr 14 12:08:16 user nova-compute[71330]:       </nova:ports>
Apr 14 12:08:16 user nova-compute[71330]:     </nova:instance>
Apr 14 12:08:16 user nova-compute[71330]:   </metadata>
Apr 14 12:08:16 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:08:16 user nova-compute[71330]:     <system>
Apr 14 12:08:16 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:08:16 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:08:16 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:08:16 user nova-compute[71330]:       <entry name="serial">5181aed1-2933-4b33-893e-eb30a0d4ff4c</entry>
Apr 14 12:08:16 user nova-compute[71330]:       <entry name="uuid">5181aed1-2933-4b33-893e-eb30a0d4ff4c</entry>
Apr 14 12:08:16 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:08:16 user nova-compute[71330]:     </system>
Apr 14 12:08:16 user nova-compute[71330]:   </sysinfo>
Apr 14 12:08:16 user nova-compute[71330]:   <os>
Apr 14 12:08:16 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:08:16 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:08:16 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:08:16 user nova-compute[71330]:   </os>
Apr 14 12:08:16 user nova-compute[71330]:   <features>
Apr 14 12:08:16 user nova-compute[71330]:     <acpi/>
Apr 14 12:08:16 user nova-compute[71330]:     <apic/>
Apr 14 12:08:16 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:08:16 user nova-compute[71330]:   </features>
Apr 14 12:08:16 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:08:16 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:08:16 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:08:16 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:08:16 user nova-compute[71330]:   </clock>
Apr 14 12:08:16 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:08:16 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:08:16 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:08:16 user nova-compute[71330]:   </cpu>
Apr 14 12:08:16 user nova-compute[71330]:   <devices>
Apr 14 12:08:16 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:08:16 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:08:16 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk"/>
Apr 14 12:08:16 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:08:16 user nova-compute[71330]:     </disk>
Apr 14 12:08:16 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:08:16 user nova-compute[71330]:       <mac address="fa:16:3e:9e:4c:1c"/>
Apr 14 12:08:16 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:08:16 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:08:16 user nova-compute[71330]:       <target dev="tap923fca3f-14"/>
Apr 14 12:08:16 user nova-compute[71330]:     </interface>
Apr 14 12:08:16 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:08:16 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/console.log" append="off"/>
Apr 14 12:08:16 user nova-compute[71330]:     </serial>
Apr 14 12:08:16 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:08:16 user nova-compute[71330]:     <video>
Apr 14 12:08:16 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:08:16 user nova-compute[71330]:     </video>
Apr 14 12:08:16 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:08:16 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:08:16 user nova-compute[71330]:     </rng>
Apr 14 12:08:16 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:08:16 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:08:16 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:08:16 user nova-compute[71330]:     </memballoon>
Apr 14 12:08:16 user nova-compute[71330]:   </devices>
Apr 14 12:08:16 user nova-compute[71330]: </domain>
Apr 14 12:08:16 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-549197077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-549197077',id=20,image_ref='a1c2deb6-1fbe-4cd0-8501-169df29549e1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-230816513',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:04:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-q4keusmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member',shelved_at='2023-04-14T12:06:20.969478',shelved_host='user',shelved_image_id='a1c2deb6-1fbe-4cd0-8501-169df29549e1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:08:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=5181aed1-2933-4b33-893e-eb30a0d4ff4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG os_vif [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap923fca3f-14, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap923fca3f-14, col_values=(('external_ids', {'iface-id': '923fca3f-14a0-481e-8c0c-6cb7cc7a04bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:4c:1c', 'vm-uuid': '5181aed1-2933-4b33-893e-eb30a0d4ff4c'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: INFO os_vif [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14')
Apr 14 12:08:16 user nova-compute[71330]: INFO nova.compute.manager [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 12:08:16 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] No VIF found with MAC fa:16:3e:9e:4c:1c, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:08:17 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Took 0.55 seconds to deallocate network for instance.
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-vif-deleted-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:17 user nova-compute[71330]: INFO nova.compute.manager [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Neutron deleted interface 4f8abc87-2a83-454a-9a91-eebcf782364e; detaching it from the instance and deleting it from the info cache
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.network.neutron [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Detach interface failed, port_id=4f8abc87-2a83-454a-9a91-eebcf782364e, reason: Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:17 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Deleted allocations for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc
Apr 14 12:08:17 user nova-compute[71330]: INFO nova.compute.manager [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] instance snapshotting
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-vif-unplugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] No waiting events found dispatching network-vif-unplugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:17 user nova-compute[71330]: WARNING nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received unexpected event network-vif-unplugged-4f8abc87-2a83-454a-9a91-eebcf782364e for instance with vm_state deleted and task_state None.
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] No waiting events found dispatching network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:17 user nova-compute[71330]: WARNING nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received unexpected event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e for instance with vm_state deleted and task_state None.
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] No waiting events found dispatching network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:17 user nova-compute[71330]: WARNING nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received unexpected event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e for instance with vm_state deleted and task_state None.
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] No waiting events found dispatching network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:17 user nova-compute[71330]: WARNING nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received unexpected event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e for instance with vm_state deleted and task_state None.
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Acquiring lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] No waiting events found dispatching network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:17 user nova-compute[71330]: WARNING nova.compute.manager [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Received unexpected event network-vif-plugged-4f8abc87-2a83-454a-9a91-eebcf782364e for instance with vm_state deleted and task_state None.
Apr 14 12:08:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Beginning live snapshot process
Apr 14 12:08:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "b79d8978-9bc5-4a22-98cf-025f949dc1bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json -f qcow2 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json -f qcow2 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0qas5iro/f593acdc2e0d42f6b118f0af5f9b5bfd.delta 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0qas5iro/f593acdc2e0d42f6b118f0af5f9b5bfd.delta 1073741824" returned: 0 in 0.063s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 12:08:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:19 user nova-compute[71330]: WARNING nova.compute.manager [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 12:08:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:19 user nova-compute[71330]: WARNING nova.compute.manager [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 12:08:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71330) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 12:08:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:08:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0qas5iro/f593acdc2e0d42f6b118f0af5f9b5bfd.delta /opt/stack/data/nova/instances/snapshots/tmp0qas5iro/f593acdc2e0d42f6b118f0af5f9b5bfd {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0qas5iro/f593acdc2e0d42f6b118f0af5f9b5bfd.delta /opt/stack/data/nova/instances/snapshots/tmp0qas5iro/f593acdc2e0d42f6b118f0af5f9b5bfd" returned: 0 in 0.550s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Snapshot extracted, beginning image upload
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474100.8893688, 5181aed1-2933-4b33-893e-eb30a0d4ff4c => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:08:20 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] VM Resumed (Lifecycle Event)
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.compute.manager [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:08:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance spawned successfully.
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:08:20 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474100.8902977, 5181aed1-2933-4b33-893e-eb30a0d4ff4c => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:08:20 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] VM Started (Lifecycle Event)
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:08:20 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:08:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:08:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:08:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.404s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Snapshot image upload complete
Apr 14 12:08:23 user nova-compute[71330]: INFO nova.compute.manager [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Took 5.33 seconds to snapshot the instance on the hypervisor.
Apr 14 12:08:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:28 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474093.5385118, bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:08:28 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] VM Stopped (Lifecycle Event)
Apr 14 12:08:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3e2cecfe-a7d7-48ad-8613-059c97fdd13f None None] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:08:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:31 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474096.7518272, b79d8978-9bc5-4a22-98cf-025f949dc1bc => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:08:31 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] VM Stopped (Lifecycle Event)
Apr 14 12:08:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-93188c40-d932-4d51-b40d-7aa105e6973f None None] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:08:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:39 user nova-compute[71330]: INFO nova.compute.manager [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Terminating instance
Apr 14 12:08:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-unplugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] No waiting events found dispatching network-vif-unplugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-unplugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:08:40 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Instance destroyed successfully.
Apr 14 12:08:40 user nova-compute[71330]: DEBUG nova.objects.instance [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'resources' on Instance uuid 075f81e9-8b43-4b05-96be-6eb4cca6d812 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-547707512',display_name='tempest-TestMinimumBasicScenario-server-547707512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-547707512',id=19,image_ref='3e365d0f-5c6c-4685-b457-90f08aed34f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7XKwiLURj1b5DcTPIVltofftkFGkMimaP6U6s5L9tKtbMKTAUfGzDVvjquRa1/D5ZC1MIwS3Ey8mqJF+pxbMc2DT2o0F12fH+EYHR0P8dd1BBqsgvlbTWVDPzdYVfF1A==',key_name='tempest-TestMinimumBasicScenario-1755081879',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:03:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd9936aa363942f6a01bb64a8a8e74c9',ramdisk_id='',reservation_id='r-5dreax2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3e365d0f-5c6c-4685-b457-90f08aed34f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-881161311',owner_user_name='tempest-TestMinimumBasicScenario-881161311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:06:02Z,user_data=None,user_id='2eb32a03e7e04da18568294cca0e69bd',uuid=075f81e9-8b43-4b05-96be-6eb4cca6d812,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converting VIF {"id": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "address": "fa:16:3e:db:5e:1a", "network": {"id": "c96cae42-6598-4610-a86f-165acef484f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1642797947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9936aa363942f6a01bb64a8a8e74c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8047706-f6", "ovs_interfaceid": "a8047706-f64e-47f2-bb99-b1e66dbd2df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:5e:1a,bridge_name='br-int',has_traffic_filtering=True,id=a8047706-f64e-47f2-bb99-b1e66dbd2df8,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8047706-f6') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG os_vif [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:5e:1a,bridge_name='br-int',has_traffic_filtering=True,id=a8047706-f64e-47f2-bb99-b1e66dbd2df8,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8047706-f6') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8047706-f6, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:08:40 user nova-compute[71330]: INFO os_vif [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:5e:1a,bridge_name='br-int',has_traffic_filtering=True,id=a8047706-f64e-47f2-bb99-b1e66dbd2df8,network=Network(c96cae42-6598-4610-a86f-165acef484f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8047706-f6')
Apr 14 12:08:40 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Deleting instance files /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812_del
Apr 14 12:08:40 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Deletion of /opt/stack/data/nova/instances/075f81e9-8b43-4b05-96be-6eb4cca6d812_del complete
Apr 14 12:08:40 user nova-compute[71330]: INFO nova.compute.manager [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 12:08:40 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:08:40 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:08:41 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:08:41 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Took 0.52 seconds to deallocate network for instance.
Apr 14 12:08:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:41 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:08:41 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:08:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:41 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Deleted allocations for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812
Apr 14 12:08:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.969s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:42 user nova-compute[71330]: DEBUG nova.compute.manager [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] Acquiring lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] Lock "075f81e9-8b43-4b05-96be-6eb4cca6d812-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:42 user nova-compute[71330]: DEBUG nova.compute.manager [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] No waiting events found dispatching network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:08:42 user nova-compute[71330]: WARNING nova.compute.manager [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received unexpected event network-vif-plugged-a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance with vm_state deleted and task_state None.
Apr 14 12:08:42 user nova-compute[71330]: DEBUG nova.compute.manager [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Received event network-vif-deleted-a8047706-f64e-47f2-bb99-b1e66dbd2df8 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:08:44 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:08:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 12:08:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:08:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:08:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:54 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:08:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474120.7018552, 075f81e9-8b43-4b05-96be-6eb4cca6d812 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:08:55 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] VM Stopped (Lifecycle Event)
Apr 14 12:08:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fa195424-0fa7-4a60-a608-1ff1af12fa11 None None] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:08:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:08:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:08:57 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:08:57 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:08:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=26.03799819946289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:08:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:08:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 545be51c-649c-4297-a924-bbb6ecf303dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:08:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:08:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-changed-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Refreshing instance network info cache due to event network-changed-fd5df68e-d97d-41be-a98a-d5d7b77a0044. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:09:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] Acquiring lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:09:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] Acquired lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:09:13 user nova-compute[71330]: DEBUG nova.network.neutron [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Refreshing network info cache for port fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:14 user nova-compute[71330]: INFO nova.compute.manager [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Terminating instance
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-unplugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] No waiting events found dispatching network-vif-unplugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-unplugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updated VIF entry in instance network info cache for port fd5df68e-d97d-41be-a98a-d5d7b77a0044. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updating instance_info_cache with network_info: [{"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] Releasing lock "refresh_cache-ba2689ad-6a47-45c2-b5db-bec9e5a152ac" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Instance destroyed successfully.
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.objects.instance [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'resources' on Instance uuid ba2689ad-6a47-45c2-b5db-bec9e5a152ac {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1734254147',display_name='tempest-TestStampPattern-server-1734254147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1734254147',id=17,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcWumXfNSjLDovtKNaUkPPvNJyQGmlmWEq5lmR1ljchHoI3F3BUNa7dKibvc69DYc5cYCD1AWmxfaa3wcxsCbua+WlZRoR5F/ExK2Ac04hcBu8nxWqQ13C+9/nYhnqwIg==',key_name='tempest-TestStampPattern-1794429979',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfb2ac7942e1473f88b05de5aa79a3ee',ramdisk_id='',reservation_id='r-9ze94gji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1032317746',owner_user_name='tempest-TestStampPattern-1032317746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:05:19Z,user_data=None,user_id='e2b8b516910f41ffbb8bbf5f9e3c2ec8',uuid=ba2689ad-6a47-45c2-b5db-bec9e5a152ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converting VIF {"id": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "address": "fa:16:3e:88:52:4c", "network": {"id": "322f7f95-663e-4341-af0e-2a66ec4a1c70", "bridge": "br-int", "label": "tempest-TestStampPattern-25546528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfb2ac7942e1473f88b05de5aa79a3ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5df68e-d9", "ovs_interfaceid": "fd5df68e-d97d-41be-a98a-d5d7b77a0044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:52:4c,bridge_name='br-int',has_traffic_filtering=True,id=fd5df68e-d97d-41be-a98a-d5d7b77a0044,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5df68e-d9') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG os_vif [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:52:4c,bridge_name='br-int',has_traffic_filtering=True,id=fd5df68e-d97d-41be-a98a-d5d7b77a0044,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5df68e-d9') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd5df68e-d9, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:09:14 user nova-compute[71330]: INFO os_vif [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:52:4c,bridge_name='br-int',has_traffic_filtering=True,id=fd5df68e-d97d-41be-a98a-d5d7b77a0044,network=Network(322f7f95-663e-4341-af0e-2a66ec4a1c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5df68e-d9')
Apr 14 12:09:14 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Deleting instance files /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac_del
Apr 14 12:09:14 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Deletion of /opt/stack/data/nova/instances/ba2689ad-6a47-45c2-b5db-bec9e5a152ac_del complete
Apr 14 12:09:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:14 user nova-compute[71330]: INFO nova.compute.manager [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 14 12:09:14 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:09:14 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:09:15 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Took 0.84 seconds to deallocate network for instance.
Apr 14 12:09:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-31d2f954-2a41-4902-9f2a-6febb62a6058 req-8924faf3-dd7e-45fd-bc88-6616adb2ab7b service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-deleted-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:16 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Deleted allocations for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.306s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] No waiting events found dispatching network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:16 user nova-compute[71330]: WARNING nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received unexpected event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance with vm_state deleted and task_state None.
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] No waiting events found dispatching network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:16 user nova-compute[71330]: WARNING nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received unexpected event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance with vm_state deleted and task_state None.
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] No waiting events found dispatching network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:16 user nova-compute[71330]: WARNING nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received unexpected event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance with vm_state deleted and task_state None.
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-unplugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] No waiting events found dispatching network-vif-unplugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:16 user nova-compute[71330]: WARNING nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received unexpected event network-vif-unplugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance with vm_state deleted and task_state None.
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Acquiring lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "ba2689ad-6a47-45c2-b5db-bec9e5a152ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] No waiting events found dispatching network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:16 user nova-compute[71330]: WARNING nova.compute.manager [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Received unexpected event network-vif-plugged-fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance with vm_state deleted and task_state None.
Apr 14 12:09:16 user nova-compute[71330]: INFO nova.compute.manager [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Unrescuing
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquired lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:09:16 user nova-compute[71330]: DEBUG nova.network.neutron [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:09:17 user nova-compute[71330]: DEBUG nova.network.neutron [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating instance_info_cache with network_info: [{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:09:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Releasing lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:09:17 user nova-compute[71330]: DEBUG nova.objects.instance [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'flavor' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:09:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Instance destroyed successfully.
Apr 14 12:09:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-unplugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-unplugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:18 user nova-compute[71330]: WARNING nova.compute.manager [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-unplugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:09:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:18 user nova-compute[71330]: WARNING nova.compute.manager [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "0da5f24e-8cf1-4318-a4f4-e53c16756510" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:18 user nova-compute[71330]: INFO nova.compute.manager [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Terminating instance
Apr 14 12:09:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Instance destroyed successfully.
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'resources' on Instance uuid 0da5f24e-8cf1-4318-a4f4-e53c16756510 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-661642535',display_name='tempest-TestVolumeBootPattern-server-661642535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-661642535',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:07:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-gb2849nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:07:45Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=0da5f24e-8cf1-4318-a4f4-e53c16756510,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "a634601e-0b2d-48e8-8777-f6ceec473beb", "address": "fa:16:3e:22:53:9f", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa634601e-0b", "ovs_interfaceid": "a634601e-0b2d-48e8-8777-f6ceec473beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=a634601e-0b2d-48e8-8777-f6ceec473beb,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa634601e-0b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_vif [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=a634601e-0b2d-48e8-8777-f6ceec473beb,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa634601e-0b') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa634601e-0b, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:20 user nova-compute[71330]: INFO os_vif [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=a634601e-0b2d-48e8-8777-f6ceec473beb,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa634601e-0b')
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBbHLEoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:09:20 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2340f6-0e92-45a3-8d47-e20a9f62ed3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:09:20 user nova-compute[71330]: No targets found.
Apr 14 12:09:20 user nova-compute[71330]: iSNS:
Apr 14 12:09:20 user nova-compute[71330]: No targets found.
Apr 14 12:09:20 user nova-compute[71330]: STATIC:
Apr 14 12:09:20 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:09:20 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:09:20 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:09:20 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79
Apr 14 12:09:20 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:09:20 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:09:20 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c
Apr 14 12:09:20 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:09:20 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:09:20 user nova-compute[71330]: FIRMWARE:
Apr 14 12:09:20 user nova-compute[71330]: No targets found.
Apr 14 12:09:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:09:20 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:09:20 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[41024b47-5535-4e38-ad30-449dbf225b57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf8dbd7-a61f-4d8a-97a2-4df802476990]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:09:20 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:09:20 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:09:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:09:20 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:09:20 user nova-compute[71330]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c (non-flash)
Apr 14 12:09:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495f9b6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c'): ({'sdd'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Removing single pathed devices sdd {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d01918-6fa6-4036-8dad-9363809d89ae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab57a77-e303-4311-b3dc-c1f3654c8517]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flushing IO for device /dev/sdd {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0763076-69c8-4d43-9a21-e8e0b3c43f29]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[446e14ed-236b-4825-9cd8-586fc6ede87b]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28b56bf-0422-45ab-b85e-9e31bc494c20]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82ece8f-ca59-4900-8328-f09f21346940]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c, portal: 172.16.0.220,3260]
Apr 14 12:09:20 user nova-compute[71330]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c, portal: 172.16.0.220,3260] successful.
Apr 14 12:09:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received event network-vif-unplugged-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Acquiring lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] No waiting events found dispatching network-vif-unplugged-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received event network-vif-unplugged-a634601e-0b2d-48e8-8777-f6ceec473beb for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received event network-vif-plugged-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Acquiring lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] No waiting events found dispatching network-vif-plugged-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:20 user nova-compute[71330]: WARNING nova.compute.manager [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received unexpected event network-vif-plugged-a634601e-0b2d-48e8-8777-f6ceec473beb for instance with vm_state active and task_state deleting.
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:20 user nova-compute[71330]: WARNING nova.compute.manager [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8878ec93-6038-4aec-975c-11da89cc817c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfa12ea-c2e7-4282-9910-f8dccf6a8cb8]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== disconnect_volume: return (383ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:09:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Deleting instance files /opt/stack/data/nova/instances/0da5f24e-8cf1-4318-a4f4-e53c16756510_del
Apr 14 12:09:20 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Deletion of /opt/stack/data/nova/instances/0da5f24e-8cf1-4318-a4f4-e53c16756510_del complete
Apr 14 12:09:20 user nova-compute[71330]: INFO nova.compute.manager [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Took 1.77 seconds to destroy the instance on the hypervisor.
Apr 14 12:09:20 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:09:20 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:09:21 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:09:21 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Took 0.57 seconds to deallocate network for instance.
Apr 14 12:09:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-3f404c0b-ffbb-400b-89e2-e9b82ae24c69 req-89b43aaf-9ee8-4985-8591-96b04bf1cacc service nova] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Received event network-vif-deleted-a634601e-0b2d-48e8-8777-f6ceec473beb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:21 user nova-compute[71330]: INFO nova.compute.manager [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Took 0.81 seconds to detach 1 volumes for instance.
Apr 14 12:09:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Deleting volume: 8878ec93-6038-4aec-975c-11da89cc817c {{(pid=71330) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474162.3720558, 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:09:22 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] VM Resumed (Lifecycle Event)
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:09:22 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474162.3722606, 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:09:22 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] VM Started (Lifecycle Event)
Apr 14 12:09:22 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Deleted allocations for instance 0da5f24e-8cf1-4318-a4f4-e53c16756510
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "0da5f24e-8cf1-4318-a4f4-e53c16756510" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.731s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.compute.manager [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:22 user nova-compute[71330]: DEBUG nova.compute.manager [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:22 user nova-compute[71330]: WARNING nova.compute.manager [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state active and task_state None.
Apr 14 12:09:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:09:26 user nova-compute[71330]: INFO nova.compute.claims [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Claim successful on node user
Apr 14 12:09:26 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:09:26 user nova-compute[71330]: DEBUG nova.network.neutron [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:09:26 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:09:26 user nova-compute[71330]: DEBUG nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:09:26 user nova-compute[71330]: INFO nova.virt.block_device [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Booting with volume-backed-image a84e226d-f438-4fb3-96fe-51f5960a6c87 at /dev/vda
Apr 14 12:09:26 user nova-compute[71330]: DEBUG nova.policy [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:09:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Successfully created port: 6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Successfully updated port: 6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquired lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-changed-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG nova.compute.manager [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Refreshing instance network info cache due to event network-changed-6facec09-5fc6-423c-9c30-9a1ca2ea0d05. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] Acquiring lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG nova.network.neutron [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Updating instance_info_cache with network_info: [{"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Releasing lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Instance network_info: |[{"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] Acquired lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:09:28 user nova-compute[71330]: DEBUG nova.network.neutron [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Refreshing network info cache for port 6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:09:29 user nova-compute[71330]: DEBUG nova.network.neutron [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Updated VIF entry in instance network info cache for port 6facec09-5fc6-423c-9c30-9a1ca2ea0d05. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:09:29 user nova-compute[71330]: DEBUG nova.network.neutron [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Updating instance_info_cache with network_info: [{"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:09:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] Releasing lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:09:29 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474154.827948, ba2689ad-6a47-45c2-b5db-bec9e5a152ac => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:09:29 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] VM Stopped (Lifecycle Event)
Apr 14 12:09:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-beecdec8-f5af-48c7-aff9-32c0cbf806e5 None None] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:09:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:09:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:09:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:09:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:09:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG os_brick.utils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb69c0a1-b3ab-42ad-aa7a-c90c48b4eb4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c0b722-0b48-4eed-9824-c1c1f37638e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cc92be-6dc0-4a6e-80e7-4ef771e87db8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5386486-3672-4498-9238-2dfe700c31d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:09:32 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:09:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f90a4f-52b9-4369-a8a4-c6bdc8241881]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG os_brick.utils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:09:32 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Updating existing volume attachment record: 01f2da6a-c6ef-4e42-a0be-6e957f138174 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:09:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:35 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474160.0221655, 0da5f24e-8cf1-4318-a4f4-e53c16756510 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:09:35 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] VM Stopped (Lifecycle Event)
Apr 14 12:09:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ccca2372-89fa-4dc1-9c9b-34af9092ebe5 None None] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:09:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:09:38 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Creating image(s)
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Ensure instance console log exists: /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Start _get_guest_xml network_info=[{"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '01f2da6a-c6ef-4e42-a0be-6e957f138174', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKxFToAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5b4cd5e-d786-4c51-978b-7ff76e21d1b2', 'attached_at': '', 'detached_at': '', 'volume_id': '619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 'serial': '619cf8ad-1c8f-46f7-9838-4ea7cbceb050'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:09:38 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:09:38 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKxFToAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:09:38 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:09:38 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:09:38 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0a87c-f81d-4cd7-936d-1c3649f81c0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:09:38 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e1cb4f-2a5f-464f-b13c-980955fc974c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050] added
Apr 14 12:09:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae9f5b1-8d6f-4b92-9eb2-d10717c0cc50]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[179a75a0-a03a-4988-8c18-9cc476a0cf9f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKxFToAs {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKxFToAs" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2887cd-09e6-4f29-999b-4856586fa1fb]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nKxFToAs'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c202c6af-7b60-4148-b349-3037f21b5330]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e4baf6-96e0-46be-b51d-6fe3ba0bc535]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7303bb69-3253-4136-b16a-dce020490da2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050, portal: 172.16.0.220,3260]
Apr 14 12:09:38 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050, portal: 172.16.0.220,3260] successful.
Apr 14 12:09:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[202bfde4-402f-4ed7-89b3-75ac421bc08d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba47f30-8684-4ed1-b575-7818a9aee02f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:09:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccce1235-f9fd-4ed7-8b07-05c09abd8d76]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:09:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKxFToAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23439376137353339', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439376137353339', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1172257873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1172257873',id=27,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-hbo3f45m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:09:27Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=b5b4cd5e-d786-4c51-978b-7ff76e21d1b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:54:50,bridge_name='br-int',has_traffic_filtering=True,id=6facec09-5fc6-423c-9c30-9a1ca2ea0d05,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6facec09-5f') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.objects.instance [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'pci_devices' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:09:39 user nova-compute[71330]:   <uuid>b5b4cd5e-d786-4c51-978b-7ff76e21d1b2</uuid>
Apr 14 12:09:39 user nova-compute[71330]:   <name>instance-0000001b</name>
Apr 14 12:09:39 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:09:39 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:09:39 user nova-compute[71330]:   <metadata>
Apr 14 12:09:39 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:09:39 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:09:39 user nova-compute[71330]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1172257873</nova:name>
Apr 14 12:09:39 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:09:38</nova:creationTime>
Apr 14 12:09:39 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:09:39 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:09:39 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:09:39 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:09:39 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:09:39 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:09:39 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:09:39 user nova-compute[71330]:       <nova:owner>
Apr 14 12:09:39 user nova-compute[71330]:         <nova:user uuid="11df88c60e4b456691d8731fe8facf38">tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member</nova:user>
Apr 14 12:09:39 user nova-compute[71330]:         <nova:project uuid="2c5140d4419e43be941c2ac5d5439e35">tempest-ServerBootFromVolumeStableRescueTest-1565599676</nova:project>
Apr 14 12:09:39 user nova-compute[71330]:       </nova:owner>
Apr 14 12:09:39 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:09:39 user nova-compute[71330]:       <nova:ports>
Apr 14 12:09:39 user nova-compute[71330]:         <nova:port uuid="6facec09-5fc6-423c-9c30-9a1ca2ea0d05">
Apr 14 12:09:39 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 12:09:39 user nova-compute[71330]:         </nova:port>
Apr 14 12:09:39 user nova-compute[71330]:       </nova:ports>
Apr 14 12:09:39 user nova-compute[71330]:     </nova:instance>
Apr 14 12:09:39 user nova-compute[71330]:   </metadata>
Apr 14 12:09:39 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:09:39 user nova-compute[71330]:     <system>
Apr 14 12:09:39 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:09:39 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:09:39 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:09:39 user nova-compute[71330]:       <entry name="serial">b5b4cd5e-d786-4c51-978b-7ff76e21d1b2</entry>
Apr 14 12:09:39 user nova-compute[71330]:       <entry name="uuid">b5b4cd5e-d786-4c51-978b-7ff76e21d1b2</entry>
Apr 14 12:09:39 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:09:39 user nova-compute[71330]:     </system>
Apr 14 12:09:39 user nova-compute[71330]:   </sysinfo>
Apr 14 12:09:39 user nova-compute[71330]:   <os>
Apr 14 12:09:39 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:09:39 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:09:39 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:09:39 user nova-compute[71330]:   </os>
Apr 14 12:09:39 user nova-compute[71330]:   <features>
Apr 14 12:09:39 user nova-compute[71330]:     <acpi/>
Apr 14 12:09:39 user nova-compute[71330]:     <apic/>
Apr 14 12:09:39 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:09:39 user nova-compute[71330]:   </features>
Apr 14 12:09:39 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:09:39 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:09:39 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:09:39 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:09:39 user nova-compute[71330]:   </clock>
Apr 14 12:09:39 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:09:39 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:09:39 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:09:39 user nova-compute[71330]:   </cpu>
Apr 14 12:09:39 user nova-compute[71330]:   <devices>
Apr 14 12:09:39 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:09:39 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:09:39 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 12:09:39 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:09:39 user nova-compute[71330]:       <serial>619cf8ad-1c8f-46f7-9838-4ea7cbceb050</serial>
Apr 14 12:09:39 user nova-compute[71330]:     </disk>
Apr 14 12:09:39 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:09:39 user nova-compute[71330]:       <mac address="fa:16:3e:ff:54:50"/>
Apr 14 12:09:39 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:09:39 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:09:39 user nova-compute[71330]:       <target dev="tap6facec09-5f"/>
Apr 14 12:09:39 user nova-compute[71330]:     </interface>
Apr 14 12:09:39 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:09:39 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/console.log" append="off"/>
Apr 14 12:09:39 user nova-compute[71330]:     </serial>
Apr 14 12:09:39 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:09:39 user nova-compute[71330]:     <video>
Apr 14 12:09:39 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:09:39 user nova-compute[71330]:     </video>
Apr 14 12:09:39 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:09:39 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:09:39 user nova-compute[71330]:     </rng>
Apr 14 12:09:39 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:09:39 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:09:39 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:09:39 user nova-compute[71330]:     </memballoon>
Apr 14 12:09:39 user nova-compute[71330]:   </devices>
Apr 14 12:09:39 user nova-compute[71330]: </domain>
Apr 14 12:09:39 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1172257873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1172257873',id=27,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-hbo3f45m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:09:27Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=b5b4cd5e-d786-4c51-978b-7ff76e21d1b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:54:50,bridge_name='br-int',has_traffic_filtering=True,id=6facec09-5fc6-423c-9c30-9a1ca2ea0d05,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6facec09-5f') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG os_vif [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:54:50,bridge_name='br-int',has_traffic_filtering=True,id=6facec09-5fc6-423c-9c30-9a1ca2ea0d05,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6facec09-5f') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6facec09-5f, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6facec09-5f, col_values=(('external_ids', {'iface-id': '6facec09-5fc6-423c-9c30-9a1ca2ea0d05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:54:50', 'vm-uuid': 'b5b4cd5e-d786-4c51-978b-7ff76e21d1b2'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:39 user nova-compute[71330]: INFO os_vif [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:54:50,bridge_name='br-int',has_traffic_filtering=True,id=6facec09-5fc6-423c-9c30-9a1ca2ea0d05,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6facec09-5f')
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:09:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No VIF found with MAC fa:16:3e:ff:54:50, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:09:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:41 user nova-compute[71330]: WARNING nova.compute.manager [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state building and task_state spawning.
Apr 14 12:09:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474183.4642084, b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:09:43 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] VM Resumed (Lifecycle Event)
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:09:43 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Instance spawned successfully.
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:09:43 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474183.4689994, b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:09:43 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] VM Started (Lifecycle Event)
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.compute.manager [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.compute.manager [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:09:43 user nova-compute[71330]: WARNING nova.compute.manager [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state building and task_state spawning.
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:09:43 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:09:43 user nova-compute[71330]: INFO nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Took 5.32 seconds to spawn the instance on the hypervisor.
Apr 14 12:09:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:09:43 user nova-compute[71330]: INFO nova.compute.manager [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Took 17.43 seconds to build instance.
Apr 14 12:09:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.542s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:09:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:09:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:09:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:09:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:09:48 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:09:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:09:49 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updating instance_info_cache with network_info: [{"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:09:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-16a25a1d-bc8b-4de0-b975-037aee0d46ee" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:09:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:09:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:09:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:09:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:09:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:09:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:09:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:09:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:09:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:09:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:09:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:55 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:09:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:56 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:09:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:09:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:09:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:59 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:09:59 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7809MB free_disk=26.154911041259766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 545be51c-649c-4297-a924-bbb6ecf303dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.384s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:09:59 user nova-compute[71330]: INFO nova.compute.claims [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Claim successful on node user
Apr 14 12:09:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:09:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:09:59 user nova-compute[71330]: INFO nova.compute.manager [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Terminating instance
Apr 14 12:09:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:10:00 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-unplugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-unplugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-unplugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:10:00 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Creating image(s)
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "/opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "/opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "/opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG nova.policy [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4e6f51853194dd7931111ff84ea10fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f89371d6c614961849733631ca6be66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.157s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.179s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:01 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Instance destroyed successfully.
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.objects.instance [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'resources' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk 1073741824" returned: 0 in 0.066s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-549197077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-549197077',id=20,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhVkEGSeuEZ8Y3htZW1HZinPHvrQPcgejbT/OFh6MfFN2VsnJTbLJi/gTpjMXD41LAKZDrh6KlePbKIa4x2/AbhT90RWYLa4yStEwS5RH7EDrtgqbiBmKAuxLp4/ClApA==',key_name='tempest-keypair-230816513',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:08:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc13fb093d2745e8ba0152533140b6f2',ramdisk_id='',reservation_id='r-q4keusmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457966394',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457966394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='260d1d4ef5a1422f84f9d91224b53952',uuid=5181aed1-2933-4b33-893e-eb30a0d4ff4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converting VIF {"id": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "address": "fa:16:3e:9e:4c:1c", "network": {"id": "6c442217-393f-4d6e-af13-517003dddfa2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1311420103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc13fb093d2745e8ba0152533140b6f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923fca3f-14", "ovs_interfaceid": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG os_vif [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap923fca3f-14, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:10:01 user nova-compute[71330]: INFO os_vif [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4c:1c,bridge_name='br-int',has_traffic_filtering=True,id=923fca3f-14a0-481e-8c0c-6cb7cc7a04bb,network=Network(6c442217-393f-4d6e-af13-517003dddfa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923fca3f-14')
Apr 14 12:10:01 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Deleting instance files /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c_del
Apr 14 12:10:01 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Deletion of /opt/stack/data/nova/instances/5181aed1-2933-4b33-893e-eb30a0d4ff4c_del complete
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.172s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:01 user nova-compute[71330]: INFO nova.compute.manager [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Took 1.28 seconds to destroy the instance on the hypervisor.
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Cannot resize image /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.objects.instance [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'migration_context' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Ensure instance console log exists: /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Successfully created port: d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:10:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] Acquiring lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] No waiting events found dispatching network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:02 user nova-compute[71330]: WARNING nova.compute.manager [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received unexpected event network-vif-plugged-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance with vm_state active and task_state deleting.
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:10:03 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Took 1.76 seconds to deallocate network for instance.
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'flavor' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Successfully updated port: d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquired lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:10:03 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Deleted allocations for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "5181aed1-2933-4b33-893e-eb30a0d4ff4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.596s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:03 user nova-compute[71330]: INFO nova.compute.manager [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attaching volume e42f9d56-b181-465a-9ed8-ef4b1f47832b to /dev/vdb
Apr 14 12:10:03 user nova-compute[71330]: DEBUG os_brick.utils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58474c9-f7ab-4e11-947d-a6da0cb06d6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[329af82e-e9c1-4021-b7f7-6a1de6a373d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bea842e-7ba7-408e-a9ac-6583e8c6144d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c30122-fd6c-4c73-bf6f-bc83eed92ff3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:10:03 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b871c3-1a9c-44ab-b977-5f29db7d92a2]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG os_brick.utils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating existing volume attachment record: 2859d9f6-b5e7-4e4d-89ba-735a4e2a60a7 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating instance_info_cache with network_info: [{"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Releasing lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Instance network_info: |[{"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Start _get_guest_xml network_info=[{"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:10:03 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:10:03 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-665226386',display_name='tempest-SnapshotDataIntegrityTests-server-665226386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-665226386',id=28,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeK2kkEDkG9iLiMYwLTjGqJrptZva+1c0p4rLwp6Kk8Ay66sIEsFK5byYYvBJZAtQ3XJxpD1thW71w6SHAc/DlHS3qz+eCj4QMPuTIrIFeoZQnSEs/TE6quNmIDzUDixQ==',key_name='tempest-SnapshotDataIntegrityTests-1808636935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f89371d6c614961849733631ca6be66',ramdisk_id='',reservation_id='r-laxuwkyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-785189652',owner_user_name='tempest-SnapshotDataIntegrityTests-785189652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:10:01Z,user_data=None,user_id='f4e6f51853194dd7931111ff84ea10fb',uuid=a83e502a-7b98-4a46-ae3d-82339fbf07ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Converting VIF {"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:30:0b,bridge_name='br-int',has_traffic_filtering=True,id=d1f86382-dd60-47d2-afae-5bbfd54c7489,network=Network(c440d25d-1de9-42ef-b8fd-bb92d9a2a30d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f86382-dd') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.objects.instance [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'pci_devices' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:10:03 user nova-compute[71330]:   <uuid>a83e502a-7b98-4a46-ae3d-82339fbf07ca</uuid>
Apr 14 12:10:03 user nova-compute[71330]:   <name>instance-0000001c</name>
Apr 14 12:10:03 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:10:03 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:10:03 user nova-compute[71330]:   <metadata>
Apr 14 12:10:03 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:10:03 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:10:03 user nova-compute[71330]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-665226386</nova:name>
Apr 14 12:10:03 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:10:03</nova:creationTime>
Apr 14 12:10:03 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:10:03 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:10:03 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:10:03 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:10:03 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:10:03 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:10:03 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:10:03 user nova-compute[71330]:       <nova:owner>
Apr 14 12:10:03 user nova-compute[71330]:         <nova:user uuid="f4e6f51853194dd7931111ff84ea10fb">tempest-SnapshotDataIntegrityTests-785189652-project-member</nova:user>
Apr 14 12:10:03 user nova-compute[71330]:         <nova:project uuid="4f89371d6c614961849733631ca6be66">tempest-SnapshotDataIntegrityTests-785189652</nova:project>
Apr 14 12:10:03 user nova-compute[71330]:       </nova:owner>
Apr 14 12:10:03 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:10:03 user nova-compute[71330]:       <nova:ports>
Apr 14 12:10:03 user nova-compute[71330]:         <nova:port uuid="d1f86382-dd60-47d2-afae-5bbfd54c7489">
Apr 14 12:10:03 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 12:10:03 user nova-compute[71330]:         </nova:port>
Apr 14 12:10:03 user nova-compute[71330]:       </nova:ports>
Apr 14 12:10:03 user nova-compute[71330]:     </nova:instance>
Apr 14 12:10:03 user nova-compute[71330]:   </metadata>
Apr 14 12:10:03 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:10:03 user nova-compute[71330]:     <system>
Apr 14 12:10:03 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:10:03 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:10:03 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:10:03 user nova-compute[71330]:       <entry name="serial">a83e502a-7b98-4a46-ae3d-82339fbf07ca</entry>
Apr 14 12:10:03 user nova-compute[71330]:       <entry name="uuid">a83e502a-7b98-4a46-ae3d-82339fbf07ca</entry>
Apr 14 12:10:03 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:10:03 user nova-compute[71330]:     </system>
Apr 14 12:10:03 user nova-compute[71330]:   </sysinfo>
Apr 14 12:10:03 user nova-compute[71330]:   <os>
Apr 14 12:10:03 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:10:03 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:10:03 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:10:03 user nova-compute[71330]:   </os>
Apr 14 12:10:03 user nova-compute[71330]:   <features>
Apr 14 12:10:03 user nova-compute[71330]:     <acpi/>
Apr 14 12:10:03 user nova-compute[71330]:     <apic/>
Apr 14 12:10:03 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:10:03 user nova-compute[71330]:   </features>
Apr 14 12:10:03 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:10:03 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:10:03 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:10:03 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:10:03 user nova-compute[71330]:   </clock>
Apr 14 12:10:03 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:10:03 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:10:03 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:10:03 user nova-compute[71330]:   </cpu>
Apr 14 12:10:03 user nova-compute[71330]:   <devices>
Apr 14 12:10:03 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:10:03 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:10:03 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk"/>
Apr 14 12:10:03 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:10:03 user nova-compute[71330]:     </disk>
Apr 14 12:10:03 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:10:03 user nova-compute[71330]:       <mac address="fa:16:3e:b2:30:0b"/>
Apr 14 12:10:03 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:10:03 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:10:03 user nova-compute[71330]:       <target dev="tapd1f86382-dd"/>
Apr 14 12:10:03 user nova-compute[71330]:     </interface>
Apr 14 12:10:03 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:10:03 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/console.log" append="off"/>
Apr 14 12:10:03 user nova-compute[71330]:     </serial>
Apr 14 12:10:03 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:10:03 user nova-compute[71330]:     <video>
Apr 14 12:10:03 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:10:03 user nova-compute[71330]:     </video>
Apr 14 12:10:03 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:10:03 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:10:03 user nova-compute[71330]:     </rng>
Apr 14 12:10:03 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:10:03 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:10:03 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:10:03 user nova-compute[71330]:     </memballoon>
Apr 14 12:10:03 user nova-compute[71330]:   </devices>
Apr 14 12:10:03 user nova-compute[71330]: </domain>
Apr 14 12:10:03 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-665226386',display_name='tempest-SnapshotDataIntegrityTests-server-665226386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-665226386',id=28,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeK2kkEDkG9iLiMYwLTjGqJrptZva+1c0p4rLwp6Kk8Ay66sIEsFK5byYYvBJZAtQ3XJxpD1thW71w6SHAc/DlHS3qz+eCj4QMPuTIrIFeoZQnSEs/TE6quNmIDzUDixQ==',key_name='tempest-SnapshotDataIntegrityTests-1808636935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f89371d6c614961849733631ca6be66',ramdisk_id='',reservation_id='r-laxuwkyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-785189652',owner_user_name='tempest-SnapshotDataIntegrityTests-785189652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:10:01Z,user_data=None,user_id='f4e6f51853194dd7931111ff84ea10fb',uuid=a83e502a-7b98-4a46-ae3d-82339fbf07ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Converting VIF {"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:30:0b,bridge_name='br-int',has_traffic_filtering=True,id=d1f86382-dd60-47d2-afae-5bbfd54c7489,network=Network(c440d25d-1de9-42ef-b8fd-bb92d9a2a30d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f86382-dd') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG os_vif [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:30:0b,bridge_name='br-int',has_traffic_filtering=True,id=d1f86382-dd60-47d2-afae-5bbfd54c7489,network=Network(c440d25d-1de9-42ef-b8fd-bb92d9a2a30d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f86382-dd') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1f86382-dd, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1f86382-dd, col_values=(('external_ids', {'iface-id': 'd1f86382-dd60-47d2-afae-5bbfd54c7489', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:30:0b', 'vm-uuid': 'a83e502a-7b98-4a46-ae3d-82339fbf07ca'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:10:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:03 user nova-compute[71330]: INFO os_vif [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:30:0b,bridge_name='br-int',has_traffic_filtering=True,id=d1f86382-dd60-47d2-afae-5bbfd54c7489,network=Network(c440d25d-1de9-42ef-b8fd-bb92d9a2a30d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f86382-dd')
Apr 14 12:10:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:10:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No VIF found with MAC fa:16:3e:b2:30:0b, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:10:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Received event network-vif-deleted-923fca3f-14a0-481e-8c0c-6cb7cc7a04bb {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received event network-changed-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Refreshing instance network info cache due to event network-changed-d1f86382-dd60-47d2-afae-5bbfd54c7489. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:10:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] Acquiring lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:10:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] Acquired lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:10:04 user nova-compute[71330]: DEBUG nova.network.neutron [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Refreshing network info cache for port d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG nova.network.neutron [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updated VIF entry in instance network info cache for port d1f86382-dd60-47d2-afae-5bbfd54c7489. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG nova.network.neutron [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating instance_info_cache with network_info: [{"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] Releasing lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received event network-vif-plugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] No waiting events found dispatching network-vif-plugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:05 user nova-compute[71330]: WARNING nova.compute.manager [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received unexpected event network-vif-plugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance with vm_state building and task_state spawning.
Apr 14 12:10:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474207.5781436, a83e502a-7b98-4a46-ae3d-82339fbf07ca => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:10:07 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] VM Resumed (Lifecycle Event)
Apr 14 12:10:07 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Instance spawned successfully.
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:10:07 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474207.5792089, a83e502a-7b98-4a46-ae3d-82339fbf07ca => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:10:07 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] VM Started (Lifecycle Event)
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:10:07 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received event network-vif-plugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] No waiting events found dispatching network-vif-plugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:07 user nova-compute[71330]: WARNING nova.compute.manager [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received unexpected event network-vif-plugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance with vm_state building and task_state spawning.
Apr 14 12:10:07 user nova-compute[71330]: INFO nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Took 7.12 seconds to spawn the instance on the hypervisor.
Apr 14 12:10:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:07 user nova-compute[71330]: INFO nova.compute.manager [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Took 8.64 seconds to build instance.
Apr 14 12:10:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.767s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:10:08 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:10:08 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:10:08 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47b5bf9-2322-4c32-893e-6088a3b3a71a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:10:08 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dcc680-9652-47da-9e2e-ccd61dab4242]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b] added
Apr 14 12:10:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[45df30a4-909a-4f7e-8a54-393815186b01]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3bedd-7f9a-46b7-b965-1f035a8168e7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYGzSdrA {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYGzSdrA" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[79966c94-d066-4a6a-9d58-ac93a08e6c46]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYGzSdrA'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[834969c9-ff16-4ece-a87c-ddfcfa3cb180]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097642f-a3c0-4353-b3d1-3ff1037bce88]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b2eea3-e5a6-4065-a774-6f9f889c3608]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]
Apr 14 12:10:08 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.
Apr 14 12:10:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd24ff4-62db-4a4d-b32b-c62727b5fb43]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd98378-e16f-4660-8a0c-6c66b0d33ab7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:08 user nova-compute[71330]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfea2c4-a5f2-4c04-a600-025887e1f680]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:10:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:10:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23061626362663933', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:10:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061626362663933', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:10:09 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'flavor' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:10:09 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:10:09 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:10:09 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:10:09 user nova-compute[71330]:   <serial>e42f9d56-b181-465a-9ed8-ef4b1f47832b</serial>
Apr 14 12:10:09 user nova-compute[71330]: </disk>
Apr 14 12:10:09 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:10:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:10:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:10:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No VIF found with MAC fa:16:3e:e5:db:94, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:10:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.033s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Stashing vm_state: active {{(pid=71330) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 12:10:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:12 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'pci_requests' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:10:12 user nova-compute[71330]: INFO nova.compute.claims [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Claim successful on node user
Apr 14 12:10:12 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'resources' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:12 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'pci_devices' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:12 user nova-compute[71330]: INFO nova.compute.resource_tracker [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating resource usage from migration 463dbd5c-8d7d-4231-906e-0ce37590969c
Apr 14 12:10:13 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:10:13 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:10:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.528s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:13 user nova-compute[71330]: INFO nova.compute.manager [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Migrating
Apr 14 12:10:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:10:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:10:13 user nova-compute[71330]: INFO nova.compute.rpcapi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 12:10:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:10:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:10:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:10:13 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:10:13 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:10:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:10:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Starting migrate_disk_and_power_off {{(pid=71330) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:14 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance destroyed successfully.
Apr 14 12:10:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:05:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:10:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:e5:db:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:e5:db:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG os_vif [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7cd0790-d7, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:10:14 user nova-compute[71330]: INFO os_vif [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7')
Apr 14 12:10:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:10:14 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:10:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[858f18e1-ac8b-4b8b-9d73-9799eb40d8d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:10:14 user nova-compute[71330]: No targets found.
Apr 14 12:10:14 user nova-compute[71330]: iSNS:
Apr 14 12:10:14 user nova-compute[71330]: No targets found.
Apr 14 12:10:14 user nova-compute[71330]: STATIC:
Apr 14 12:10:14 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:10:14 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:10:14 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:10:14 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b
Apr 14 12:10:14 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:10:14 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:10:14 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:10:14 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:10:14 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:10:14 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79
Apr 14 12:10:14 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:10:14 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:10:14 user nova-compute[71330]: FIRMWARE:
Apr 14 12:10:14 user nova-compute[71330]: No targets found.
Apr 14 12:10:14 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:10:14 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:10:14 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c748b878-2bd6-40ee-a6a0-488bdbae8ef8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30584fe-1ea7-4e81-8d56-fc0a24a7874f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:15 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:15 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:15 user nova-compute[71330]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:15 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:15 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:15 user nova-compute[71330]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495d535fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:15 user nova-compute[71330]: WARNING nova.compute.manager [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state resize_migrating.
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[887c9f83-4951-4ff1-8e1f-109da386bb41]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[626e49a5-7673-4b37-8385-fc451f3ba01b]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc559a-816c-47b0-89a3-a69694592668]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dcd14c-f1b5-4ed2-a2fb-f49efe08391b]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e417a3df-4cac-432e-86ba-7f09c733bac3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75ce0d9-bbf1-4819-874c-5e716d8494c0]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]
Apr 14 12:10:15 user nova-compute[71330]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.
Apr 14 12:10:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea79fea-0d09-4e4a-b346-2b47cddc556f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== disconnect_volume: return (346ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f_resize/disk /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:15 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474200.9588363, 5181aed1-2933-4b33-893e-eb30a0d4ff4c => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:10:15 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] VM Stopped (Lifecycle Event)
Apr 14 12:10:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6264f3c7-b2f9-4ecb-b23e-1db8df9497a2 None None] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "cp -r /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f_resize/disk /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk" returned: 0 in 0.636s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f_resize/disk.info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk.info {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "cp -r /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f_resize/disk.info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk.info" returned: 0 in 0.038s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:17 user nova-compute[71330]: WARNING nova.compute.manager [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state resize_migrating.
Apr 14 12:10:17 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Port d7cd0790-d778-4855-b7ad-c0b5c0258c1b binding to destination host user is already ACTIVE {{(pid=71330) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:10:17 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG nova.network.neutron [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG os_brick.utils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea856239-d0ec-4bf6-a0e5-26169ee15054]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce8c359-32cd-4dd5-b43d-6b517ff893ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e96b4a-44d2-431c-9f66-7932edfffc8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9ec1b4-575c-434d-8437-af4ab8b15a58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:10:18 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:10:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd2c591-bd14-464f-b4f9-a444f94887e2]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:10:18 user nova-compute[71330]: DEBUG os_brick.utils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:10:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "b350d4ef-74fe-4642-b1fd-4f15e10db590" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:10:22 user nova-compute[71330]: INFO nova.compute.claims [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Claim successful on node user
Apr 14 12:10:22 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:10:22 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:10:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:10:23 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:10:23 user nova-compute[71330]: INFO nova.virt.block_device [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Booting with volume c08cb094-2346-4a3a-9cd4-758810dd7f07 at /dev/vda
Apr 14 12:10:23 user nova-compute[71330]: DEBUG nova.policy [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG os_brick.utils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c667d29a-cb53-4f89-a752-c9aff66feda9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db88399-8011-4110-ad3d-c919f91d6ed8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf87550-0a37-45cb-955a-9f99ffb1c123]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[08de2468-7f43-4c18-bd02-74e97eb9b109]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:10:23 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:10:23 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2924311-f573-4e62-a22e-a25b7e160b91]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG os_brick.utils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Updating existing volume attachment record: 45202af7-9a36-4ed6-927f-65b0d930a92a {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:10:23 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Successfully created port: 39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Successfully updated port: 39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "refresh_cache-b350d4ef-74fe-4642-b1fd-4f15e10db590" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquired lock "refresh_cache-b350d4ef-74fe-4642-b1fd-4f15e10db590" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received event network-changed-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Refreshing instance network info cache due to event network-changed-39f99cae-b8a9-4ebd-840c-f124cba0415e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] Acquiring lock "refresh_cache-b350d4ef-74fe-4642-b1fd-4f15e10db590" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:10:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Updating instance_info_cache with network_info: [{"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:10:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Releasing lock "refresh_cache-b350d4ef-74fe-4642-b1fd-4f15e10db590" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:10:25 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Instance network_info: |[{"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:10:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] Acquired lock "refresh_cache-b350d4ef-74fe-4642-b1fd-4f15e10db590" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:10:25 user nova-compute[71330]: DEBUG nova.network.neutron [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Refreshing network info cache for port 39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:10:25 user nova-compute[71330]: DEBUG nova.network.neutron [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Updated VIF entry in instance network info cache for port 39f99cae-b8a9-4ebd-840c-f124cba0415e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:10:25 user nova-compute[71330]: DEBUG nova.network.neutron [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Updating instance_info_cache with network_info: [{"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:10:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] Releasing lock "refresh_cache-b350d4ef-74fe-4642-b1fd-4f15e10db590" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Starting finish_migration {{(pid=71330) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance directory exists: not creating {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 12:10:26 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Creating image(s)
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'trusted_certs' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.160s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Cannot resize image /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Ensure instance console log exists: /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Start _get_guest_xml network_info=[{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:e5:db:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8379ab12-dcd6-427f-b443-dfdb7bea7562', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '11e4aa91-7c03-46cc-8610-78f18bbd089f', 'attached_at': '2023-04-14T12:10:26.000000', 'detached_at': '', 'volume_id': 'e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'serial': 'e42f9d56-b181-465a-9ed8-ef4b1f47832b'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:10:26 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:10:26 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:10:26 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:10:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:10:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:10:27 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:10:27 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[14948a0e-0da0-429f-95f7-d135616a40b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:10:27 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[773f297a-4d59-4fe2-ba5e-01d4d7358fc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b] added
Apr 14 12:10:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4e1818-2e71-4b2b-93c7-d641407cc9af]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5dea65-a562-438a-a64e-f7fd624f4075]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYGzSdrA {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYGzSdrA" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0affabef-ab7c-4ecb-bd8a-24cea92cb09d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYGzSdrA'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[16be514e-dfe2-4ed0-8b26-c3e00fe53551]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[38453cb4-0987-44f9-813c-cd3d909354e1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4febebd8-d164-4c66-818a-68fda5849b2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]
Apr 14 12:10:27 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.
Apr 14 12:10:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ec7e79-0562-4314-a815-9b6e353c0c62]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6bfd83-7b30-4e82-9383-cf128aa31869]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:27 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a68f36-e7fd-4dd2-a18f-06772eabf403]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:10:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23061626362663933', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061626362663933', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:05:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:e5:db:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:e5:db:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:10:28 user nova-compute[71330]:   <uuid>11e4aa91-7c03-46cc-8610-78f18bbd089f</uuid>
Apr 14 12:10:28 user nova-compute[71330]:   <name>instance-0000000f</name>
Apr 14 12:10:28 user nova-compute[71330]:   <memory>196608</memory>
Apr 14 12:10:28 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:10:28 user nova-compute[71330]:   <metadata>
Apr 14 12:10:28 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:10:28 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:10:28 user nova-compute[71330]:       <nova:name>tempest-ServerActionsTestJSON-server-451636587</nova:name>
Apr 14 12:10:28 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:10:26</nova:creationTime>
Apr 14 12:10:28 user nova-compute[71330]:       <nova:flavor name="m1.micro">
Apr 14 12:10:28 user nova-compute[71330]:         <nova:memory>192</nova:memory>
Apr 14 12:10:28 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:10:28 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:10:28 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:10:28 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:10:28 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:10:28 user nova-compute[71330]:       <nova:owner>
Apr 14 12:10:28 user nova-compute[71330]:         <nova:user uuid="7e264a59ff9b42e08095d0ce71e4d627">tempest-ServerActionsTestJSON-1592133549-project-member</nova:user>
Apr 14 12:10:28 user nova-compute[71330]:         <nova:project uuid="3e4ff63247dd4535bcd86acfde76fd34">tempest-ServerActionsTestJSON-1592133549</nova:project>
Apr 14 12:10:28 user nova-compute[71330]:       </nova:owner>
Apr 14 12:10:28 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:10:28 user nova-compute[71330]:       <nova:ports>
Apr 14 12:10:28 user nova-compute[71330]:         <nova:port uuid="d7cd0790-d778-4855-b7ad-c0b5c0258c1b">
Apr 14 12:10:28 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 12:10:28 user nova-compute[71330]:         </nova:port>
Apr 14 12:10:28 user nova-compute[71330]:       </nova:ports>
Apr 14 12:10:28 user nova-compute[71330]:     </nova:instance>
Apr 14 12:10:28 user nova-compute[71330]:   </metadata>
Apr 14 12:10:28 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:10:28 user nova-compute[71330]:     <system>
Apr 14 12:10:28 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:10:28 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:10:28 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:10:28 user nova-compute[71330]:       <entry name="serial">11e4aa91-7c03-46cc-8610-78f18bbd089f</entry>
Apr 14 12:10:28 user nova-compute[71330]:       <entry name="uuid">11e4aa91-7c03-46cc-8610-78f18bbd089f</entry>
Apr 14 12:10:28 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:10:28 user nova-compute[71330]:     </system>
Apr 14 12:10:28 user nova-compute[71330]:   </sysinfo>
Apr 14 12:10:28 user nova-compute[71330]:   <os>
Apr 14 12:10:28 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:10:28 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:10:28 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:10:28 user nova-compute[71330]:   </os>
Apr 14 12:10:28 user nova-compute[71330]:   <features>
Apr 14 12:10:28 user nova-compute[71330]:     <acpi/>
Apr 14 12:10:28 user nova-compute[71330]:     <apic/>
Apr 14 12:10:28 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:10:28 user nova-compute[71330]:   </features>
Apr 14 12:10:28 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:10:28 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:10:28 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:10:28 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:10:28 user nova-compute[71330]:   </clock>
Apr 14 12:10:28 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:10:28 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:10:28 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:10:28 user nova-compute[71330]:   </cpu>
Apr 14 12:10:28 user nova-compute[71330]:   <devices>
Apr 14 12:10:28 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:10:28 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:10:28 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk"/>
Apr 14 12:10:28 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:10:28 user nova-compute[71330]:     </disk>
Apr 14 12:10:28 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:10:28 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:10:28 user nova-compute[71330]:       <source dev="/dev/sdc"/>
Apr 14 12:10:28 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:10:28 user nova-compute[71330]:       <serial>e42f9d56-b181-465a-9ed8-ef4b1f47832b</serial>
Apr 14 12:10:28 user nova-compute[71330]:     </disk>
Apr 14 12:10:28 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:10:28 user nova-compute[71330]:       <mac address="fa:16:3e:e5:db:94"/>
Apr 14 12:10:28 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:10:28 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:10:28 user nova-compute[71330]:       <target dev="tapd7cd0790-d7"/>
Apr 14 12:10:28 user nova-compute[71330]:     </interface>
Apr 14 12:10:28 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:10:28 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/console.log" append="off"/>
Apr 14 12:10:28 user nova-compute[71330]:     </serial>
Apr 14 12:10:28 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:10:28 user nova-compute[71330]:     <video>
Apr 14 12:10:28 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:10:28 user nova-compute[71330]:     </video>
Apr 14 12:10:28 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:10:28 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:10:28 user nova-compute[71330]:     </rng>
Apr 14 12:10:28 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:10:28 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:10:28 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:10:28 user nova-compute[71330]:     </memballoon>
Apr 14 12:10:28 user nova-compute[71330]:   </devices>
Apr 14 12:10:28 user nova-compute[71330]: </domain>
Apr 14 12:10:28 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:05:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:e5:db:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:e5:db:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG os_vif [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7cd0790-d7, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7cd0790-d7, col_values=(('external_ids', {'iface-id': 'd7cd0790-d778-4855-b7ad-c0b5c0258c1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:db:94', 'vm-uuid': '11e4aa91-7c03-46cc-8610-78f18bbd089f'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:28 user nova-compute[71330]: INFO os_vif [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7')
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:10:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No VIF found with MAC fa:16:3e:e5:db:94, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:10:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:29 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474214.884857, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:10:29 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Stopped (Lifecycle Event)
Apr 14 12:10:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-56380e4c-d36b-4c63-babd-f7a85ed498ea None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:30 user nova-compute[71330]: WARNING nova.compute.manager [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state resize_finish.
Apr 14 12:10:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:10:31 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Creating image(s)
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Ensure instance console log exists: /opt/stack/data/nova/instances/b350d4ef-74fe-4642-b1fd-4f15e10db590/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Start _get_guest_xml network_info=[{"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '45202af7-9a36-4ed6-927f-65b0d930a92a', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltuNpFCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b350d4ef-74fe-4642-b1fd-4f15e10db590', 'attached_at': '', 'detached_at': '', 'volume_id': 'c08cb094-2346-4a3a-9cd4-758810dd7f07', 'serial': 'c08cb094-2346-4a3a-9cd4-758810dd7f07'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:10:31 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:10:31 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltuNpFCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:10:31 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:10:31 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:10:31 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea7f6dd-c119-404c-9009-f6350efb9cfb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:10:31 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2866ac52-b1dc-4f09-ac6f-db3bd428fe08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07] added
Apr 14 12:10:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea0aeb7-4830-4328-a6f3-308cad7ff984]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[079c6efc-9527-46bf-8459-689fe850fe9f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ltuNpFCb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ltuNpFCb" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c75f22-9f52-4dce-bf28-8a735df82682]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ltuNpFCb'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07aa8e5-1675-409c-9eb4-a726e7b72fcb]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0e3a52-0f68-4ff0-bc09-f1cc15e2862d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32b0e52-128c-45cd-8a5f-6bda5dd7a42a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07, portal: 172.16.0.220,3260]
Apr 14 12:10:31 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07, portal: 172.16.0.220,3260] successful.
Apr 14 12:10:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0997ef-5cfe-4d18-a00b-0a48eb42eace]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[68774955-72f9-4f46-93af-efa66cde4476]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:10:31 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:10:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[892962fc-5bee-4390-80a3-fa7e2f042075]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:10:31 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474232.2423184, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:10:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Resumed (Lifecycle Event)
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:10:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance running successfully.
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Failed to set time: agent not configured {{(pid=71330) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] finish_migration finished successfully. {{(pid=71330) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:10:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474232.2458334, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:10:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Started (Lifecycle Event)
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:10:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:32 user nova-compute[71330]: WARNING nova.compute.manager [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state resize_finish.
Apr 14 12:10:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltuNpFCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26634393439323736', 'path': '/dev/sdd'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393439323736', 'path': '/dev/sdd'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2088634438',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2088634438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2088634438',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-s7dz8rx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:10:23Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=b350d4ef-74fe-4642-b1fd-4f15e10db590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=39f99cae-b8a9-4ebd-840c-f124cba0415e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f99cae-b8') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.objects.instance [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'pci_devices' on Instance uuid b350d4ef-74fe-4642-b1fd-4f15e10db590 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:10:32 user nova-compute[71330]:   <uuid>b350d4ef-74fe-4642-b1fd-4f15e10db590</uuid>
Apr 14 12:10:32 user nova-compute[71330]:   <name>instance-0000001d</name>
Apr 14 12:10:32 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:10:32 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:10:32 user nova-compute[71330]:   <metadata>
Apr 14 12:10:32 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:10:32 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:10:32 user nova-compute[71330]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2088634438</nova:name>
Apr 14 12:10:32 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:10:31</nova:creationTime>
Apr 14 12:10:32 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:10:32 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:10:32 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:10:32 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:10:32 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:10:32 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:10:32 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:10:32 user nova-compute[71330]:       <nova:owner>
Apr 14 12:10:32 user nova-compute[71330]:         <nova:user uuid="511fd95d993e4837a4a612385b04fdcb">tempest-TestVolumeBootPattern-2042813947-project-member</nova:user>
Apr 14 12:10:32 user nova-compute[71330]:         <nova:project uuid="0c317cb8d6a44115b216678540c433b6">tempest-TestVolumeBootPattern-2042813947</nova:project>
Apr 14 12:10:32 user nova-compute[71330]:       </nova:owner>
Apr 14 12:10:32 user nova-compute[71330]:       <nova:ports>
Apr 14 12:10:32 user nova-compute[71330]:         <nova:port uuid="39f99cae-b8a9-4ebd-840c-f124cba0415e">
Apr 14 12:10:32 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 12:10:32 user nova-compute[71330]:         </nova:port>
Apr 14 12:10:32 user nova-compute[71330]:       </nova:ports>
Apr 14 12:10:32 user nova-compute[71330]:     </nova:instance>
Apr 14 12:10:32 user nova-compute[71330]:   </metadata>
Apr 14 12:10:32 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:10:32 user nova-compute[71330]:     <system>
Apr 14 12:10:32 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:10:32 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:10:32 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:10:32 user nova-compute[71330]:       <entry name="serial">b350d4ef-74fe-4642-b1fd-4f15e10db590</entry>
Apr 14 12:10:32 user nova-compute[71330]:       <entry name="uuid">b350d4ef-74fe-4642-b1fd-4f15e10db590</entry>
Apr 14 12:10:32 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:10:32 user nova-compute[71330]:     </system>
Apr 14 12:10:32 user nova-compute[71330]:   </sysinfo>
Apr 14 12:10:32 user nova-compute[71330]:   <os>
Apr 14 12:10:32 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:10:32 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:10:32 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:10:32 user nova-compute[71330]:   </os>
Apr 14 12:10:32 user nova-compute[71330]:   <features>
Apr 14 12:10:32 user nova-compute[71330]:     <acpi/>
Apr 14 12:10:32 user nova-compute[71330]:     <apic/>
Apr 14 12:10:32 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:10:32 user nova-compute[71330]:   </features>
Apr 14 12:10:32 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:10:32 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:10:32 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:10:32 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:10:32 user nova-compute[71330]:   </clock>
Apr 14 12:10:32 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:10:32 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:10:32 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:10:32 user nova-compute[71330]:   </cpu>
Apr 14 12:10:32 user nova-compute[71330]:   <devices>
Apr 14 12:10:32 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:10:32 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:10:32 user nova-compute[71330]:       <source dev="/dev/sdd"/>
Apr 14 12:10:32 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:10:32 user nova-compute[71330]:       <serial>c08cb094-2346-4a3a-9cd4-758810dd7f07</serial>
Apr 14 12:10:32 user nova-compute[71330]:     </disk>
Apr 14 12:10:32 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:10:32 user nova-compute[71330]:       <mac address="fa:16:3e:71:ab:7a"/>
Apr 14 12:10:32 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:10:32 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:10:32 user nova-compute[71330]:       <target dev="tap39f99cae-b8"/>
Apr 14 12:10:32 user nova-compute[71330]:     </interface>
Apr 14 12:10:32 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:10:32 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/b350d4ef-74fe-4642-b1fd-4f15e10db590/console.log" append="off"/>
Apr 14 12:10:32 user nova-compute[71330]:     </serial>
Apr 14 12:10:32 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:10:32 user nova-compute[71330]:     <video>
Apr 14 12:10:32 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:10:32 user nova-compute[71330]:     </video>
Apr 14 12:10:32 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:10:32 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:10:32 user nova-compute[71330]:     </rng>
Apr 14 12:10:32 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:10:32 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:10:32 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:10:32 user nova-compute[71330]:     </memballoon>
Apr 14 12:10:32 user nova-compute[71330]:   </devices>
Apr 14 12:10:32 user nova-compute[71330]: </domain>
Apr 14 12:10:32 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2088634438',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2088634438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2088634438',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-s7dz8rx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:10:23Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=b350d4ef-74fe-4642-b1fd-4f15e10db590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=39f99cae-b8a9-4ebd-840c-f124cba0415e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f99cae-b8') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG os_vif [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=39f99cae-b8a9-4ebd-840c-f124cba0415e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f99cae-b8') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39f99cae-b8, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39f99cae-b8, col_values=(('external_ids', {'iface-id': '39f99cae-b8a9-4ebd-840c-f124cba0415e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:ab:7a', 'vm-uuid': 'b350d4ef-74fe-4642-b1fd-4f15e10db590'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:32 user nova-compute[71330]: INFO os_vif [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=39f99cae-b8a9-4ebd-840c-f124cba0415e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f99cae-b8')
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:10:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No VIF found with MAC fa:16:3e:71:ab:7a, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received event network-vif-plugged-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] Acquiring lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] No waiting events found dispatching network-vif-plugged-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:34 user nova-compute[71330]: WARNING nova.compute.manager [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received unexpected event network-vif-plugged-39f99cae-b8a9-4ebd-840c-f124cba0415e for instance with vm_state building and task_state spawning.
Apr 14 12:10:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received event network-vif-plugged-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:10:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] Acquiring lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] No waiting events found dispatching network-vif-plugged-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:10:36 user nova-compute[71330]: WARNING nova.compute.manager [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received unexpected event network-vif-plugged-39f99cae-b8a9-4ebd-840c-f124cba0415e for instance with vm_state building and task_state spawning.
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474237.2473247, b350d4ef-74fe-4642-b1fd-4f15e10db590 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:10:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] VM Resumed (Lifecycle Event)
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:10:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Instance spawned successfully.
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:10:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474237.2485225, b350d4ef-74fe-4642-b1fd-4f15e10db590 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:10:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] VM Started (Lifecycle Event)
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:10:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:10:37 user nova-compute[71330]: INFO nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Took 5.97 seconds to spawn the instance on the hypervisor.
Apr 14 12:10:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:10:37 user nova-compute[71330]: INFO nova.compute.manager [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Took 15.05 seconds to build instance.
Apr 14 12:10:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.149s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:10:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:10:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:10:49 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:10:50 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updating instance_info_cache with network_info: [{"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:10:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-68f7b119-b1c9-47ce-b325-5a4730aef707" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:10:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:10:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:10:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:56 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:10:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:10:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:10:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:10:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:10:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:10:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:00 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:11:00 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7809MB free_disk=26.11990737915039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Applying migration context for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f as it has an incoming, in-progress migration 463dbd5c-8d7d-4231-906e-0ce37590969c. Migration status is finished {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 12:11:00 user nova-compute[71330]: INFO nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating resource usage from migration 463dbd5c-8d7d-4231-906e-0ce37590969c
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 545be51c-649c-4297-a924-bbb6ecf303dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Migration 463dbd5c-8d7d-4231-906e-0ce37590969c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:11:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:11:01 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:11:01 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:11:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:11:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-changed-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Refreshing instance network info cache due to event network-changed-3ba9407c-344c-45b8-a483-36e0c0e72ff0. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:11:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] Acquiring lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:11:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] Acquired lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:11:08 user nova-compute[71330]: DEBUG nova.network.neutron [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Refreshing network info cache for port 3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:11:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:08 user nova-compute[71330]: INFO nova.compute.manager [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Detaching volume 456eefe5-dfcc-43aa-bb82-87ee292ece79
Apr 14 12:11:08 user nova-compute[71330]: INFO nova.virt.block_device [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Attempting to driver detach volume 456eefe5-dfcc-43aa-bb82-87ee292ece79 from mountpoint /dev/vdb
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Attempting to detach device vdb from instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:11:09 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:11:09 user nova-compute[71330]:   <source dev="/dev/sdf"/>
Apr 14 12:11:09 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:11:09 user nova-compute[71330]:   <serial>456eefe5-dfcc-43aa-bb82-87ee292ece79</serial>
Apr 14 12:11:09 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:11:09 user nova-compute[71330]: </disk>
Apr 14 12:11:09 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:11:09 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Successfully detached device vdb from instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 from the persistent domain config.
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:11:09 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:11:09 user nova-compute[71330]:   <source dev="/dev/sdf"/>
Apr 14 12:11:09 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:11:09 user nova-compute[71330]:   <serial>456eefe5-dfcc-43aa-bb82-87ee292ece79</serial>
Apr 14 12:11:09 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:11:09 user nova-compute[71330]: </disk>
Apr 14 12:11:09 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.network.neutron [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updated VIF entry in instance network info cache for port 3ba9407c-344c-45b8-a483-36e0c0e72ff0. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.network.neutron [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating instance_info_cache with network_info: [{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] Releasing lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474269.5575233, 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:11:09 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Successfully detached device vdb from instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 from the live domain config.
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDywtrPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:11:09 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[14583289-61da-4d81-a664-5497544c6a6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:11:09 user nova-compute[71330]: No targets found.
Apr 14 12:11:09 user nova-compute[71330]: iSNS:
Apr 14 12:11:09 user nova-compute[71330]: No targets found.
Apr 14 12:11:09 user nova-compute[71330]: STATIC:
Apr 14 12:11:09 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:11:09 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:11:09 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:11:09 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b
Apr 14 12:11:09 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:11:09 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:11:09 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:11:09 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:11:09 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:11:09 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79
Apr 14 12:11:09 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:11:09 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:11:09 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07
Apr 14 12:11:09 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:11:09 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:11:09 user nova-compute[71330]: FIRMWARE:
Apr 14 12:11:09 user nova-compute[71330]: No targets found.
Apr 14 12:11:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:11:09 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:11:09 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36054af-4651-4cc9-8184-666efd66f044]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae797322-0f9e-4682-85b6-56071d27f496]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:11:09 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:11:09 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:11:09 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:11:09 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:11:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:11:09 user nova-compute[71330]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 (non-flash)
Apr 14 12:11:09 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:11:09 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:11:09 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:11:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962b3ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79'): ({'sdf'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Removing single pathed devices sdf {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b62024-3a75-46e5-bba1-2320f42aa92d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b47ea43-81a2-469a-9400-3977c2e801ba]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flushing IO for device /dev/sdf {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[30696834-23f8-4813-9b9f-12d4538eccda]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1b422a-36f2-487f-9e86-433db90ef5f6]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7427a271-5f03-4154-9a53-eea95cb5a151]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b3f171-d75c-407a-ab83-b2f3081b0e7a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79, portal: 172.16.0.220,3260]
Apr 14 12:11:09 user nova-compute[71330]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79, portal: 172.16.0.220,3260] successful.
Apr 14 12:11:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456eefe5-dfcc-43aa-bb82-87ee292ece79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0136f806-2a98-4faf-a057-a65102cd3374]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] <== disconnect_volume: return (355ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:11:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:11:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-changed-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Refreshing instance network info cache due to event network-changed-3ba9407c-344c-45b8-a483-36e0c0e72ff0. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:11:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] Acquiring lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:11:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] Acquired lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:11:10 user nova-compute[71330]: DEBUG nova.network.neutron [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Refreshing network info cache for port 3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:11:10 user nova-compute[71330]: DEBUG nova.objects.instance [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'flavor' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.863s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:11 user nova-compute[71330]: DEBUG nova.network.neutron [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updated VIF entry in instance network info cache for port 3ba9407c-344c-45b8-a483-36e0c0e72ff0. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:11:11 user nova-compute[71330]: DEBUG nova.network.neutron [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating instance_info_cache with network_info: [{"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:11:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] Releasing lock "refresh_cache-4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:11:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:11:12 user nova-compute[71330]: INFO nova.compute.claims [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Claim successful on node user
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.network.neutron [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:11:12 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.policy [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:11:12 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Creating image(s)
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "/opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "/opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "/opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.156s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk 1073741824" returned: 0 in 0.056s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG nova.network.neutron [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Successfully created port: 884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Cannot resize image /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG nova.objects.instance [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'migration_context' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Ensure instance console log exists: /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.neutron [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Successfully updated port: 884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquired lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.neutron [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-changed-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Refreshing instance network info cache due to event network-changed-884fdba5-501f-4614-9e53-3e4b96a90630. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] Acquiring lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.neutron [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.neutron [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updating instance_info_cache with network_info: [{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Releasing lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance network_info: |[{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] Acquired lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Refreshing network info cache for port 884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Start _get_guest_xml network_info=[{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:11:14 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:11:14 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1732004801',display_name='tempest-AttachVolumeTestJSON-server-1732004801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1732004801',id=30,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA==',key_name='tempest-keypair-529761837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-phdutbkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=9741284c-15ce-41e3-934d-bf8f46a407f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.objects.instance [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'pci_devices' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:11:14 user nova-compute[71330]:   <uuid>9741284c-15ce-41e3-934d-bf8f46a407f5</uuid>
Apr 14 12:11:14 user nova-compute[71330]:   <name>instance-0000001e</name>
Apr 14 12:11:14 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:11:14 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:11:14 user nova-compute[71330]:   <metadata>
Apr 14 12:11:14 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:11:14 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:11:14 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeTestJSON-server-1732004801</nova:name>
Apr 14 12:11:14 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:11:14</nova:creationTime>
Apr 14 12:11:14 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:11:14 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:11:14 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:11:14 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:11:14 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:11:14 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:11:14 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:11:14 user nova-compute[71330]:       <nova:owner>
Apr 14 12:11:14 user nova-compute[71330]:         <nova:user uuid="b7a65855384e4146a344cceb744e3e40">tempest-AttachVolumeTestJSON-341361172-project-member</nova:user>
Apr 14 12:11:14 user nova-compute[71330]:         <nova:project uuid="90ff3910da7c47e9828549306fda25d7">tempest-AttachVolumeTestJSON-341361172</nova:project>
Apr 14 12:11:14 user nova-compute[71330]:       </nova:owner>
Apr 14 12:11:14 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:11:14 user nova-compute[71330]:       <nova:ports>
Apr 14 12:11:14 user nova-compute[71330]:         <nova:port uuid="884fdba5-501f-4614-9e53-3e4b96a90630">
Apr 14 12:11:14 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 12:11:14 user nova-compute[71330]:         </nova:port>
Apr 14 12:11:14 user nova-compute[71330]:       </nova:ports>
Apr 14 12:11:14 user nova-compute[71330]:     </nova:instance>
Apr 14 12:11:14 user nova-compute[71330]:   </metadata>
Apr 14 12:11:14 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:11:14 user nova-compute[71330]:     <system>
Apr 14 12:11:14 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:11:14 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:11:14 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:11:14 user nova-compute[71330]:       <entry name="serial">9741284c-15ce-41e3-934d-bf8f46a407f5</entry>
Apr 14 12:11:14 user nova-compute[71330]:       <entry name="uuid">9741284c-15ce-41e3-934d-bf8f46a407f5</entry>
Apr 14 12:11:14 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:11:14 user nova-compute[71330]:     </system>
Apr 14 12:11:14 user nova-compute[71330]:   </sysinfo>
Apr 14 12:11:14 user nova-compute[71330]:   <os>
Apr 14 12:11:14 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:11:14 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:11:14 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:11:14 user nova-compute[71330]:   </os>
Apr 14 12:11:14 user nova-compute[71330]:   <features>
Apr 14 12:11:14 user nova-compute[71330]:     <acpi/>
Apr 14 12:11:14 user nova-compute[71330]:     <apic/>
Apr 14 12:11:14 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:11:14 user nova-compute[71330]:   </features>
Apr 14 12:11:14 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:11:14 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:11:14 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:11:14 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:11:14 user nova-compute[71330]:   </clock>
Apr 14 12:11:14 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:11:14 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:11:14 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:11:14 user nova-compute[71330]:   </cpu>
Apr 14 12:11:14 user nova-compute[71330]:   <devices>
Apr 14 12:11:14 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:11:14 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:11:14 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk"/>
Apr 14 12:11:14 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:11:14 user nova-compute[71330]:     </disk>
Apr 14 12:11:14 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:11:14 user nova-compute[71330]:       <mac address="fa:16:3e:30:c4:fa"/>
Apr 14 12:11:14 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:11:14 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:11:14 user nova-compute[71330]:       <target dev="tap884fdba5-50"/>
Apr 14 12:11:14 user nova-compute[71330]:     </interface>
Apr 14 12:11:14 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:11:14 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/console.log" append="off"/>
Apr 14 12:11:14 user nova-compute[71330]:     </serial>
Apr 14 12:11:14 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:11:14 user nova-compute[71330]:     <video>
Apr 14 12:11:14 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:11:14 user nova-compute[71330]:     </video>
Apr 14 12:11:14 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:11:14 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:11:14 user nova-compute[71330]:     </rng>
Apr 14 12:11:14 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:11:14 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:11:14 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:11:14 user nova-compute[71330]:     </memballoon>
Apr 14 12:11:14 user nova-compute[71330]:   </devices>
Apr 14 12:11:14 user nova-compute[71330]: </domain>
Apr 14 12:11:14 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1732004801',display_name='tempest-AttachVolumeTestJSON-server-1732004801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1732004801',id=30,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA==',key_name='tempest-keypair-529761837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-phdutbkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=9741284c-15ce-41e3-934d-bf8f46a407f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG os_vif [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap884fdba5-50, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap884fdba5-50, col_values=(('external_ids', {'iface-id': '884fdba5-501f-4614-9e53-3e4b96a90630', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:c4:fa', 'vm-uuid': '9741284c-15ce-41e3-934d-bf8f46a407f5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:14 user nova-compute[71330]: INFO os_vif [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50')
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No VIF found with MAC fa:16:3e:30:c4:fa, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updated VIF entry in instance network info cache for port 884fdba5-501f-4614-9e53-3e4b96a90630. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG nova.network.neutron [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updating instance_info_cache with network_info: [{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:11:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] Releasing lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:11:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:11:16 user nova-compute[71330]: WARNING nova.compute.manager [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state building and task_state spawning.
Apr 14 12:11:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:16 user nova-compute[71330]: INFO nova.compute.manager [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Rescuing
Apr 14 12:11:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquired lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:11:16 user nova-compute[71330]: DEBUG nova.network.neutron [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG nova.network.neutron [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Updating instance_info_cache with network_info: [{"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Releasing lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-unplugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-unplugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:11:17 user nova-compute[71330]: WARNING nova.compute.manager [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-unplugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state active and task_state rescuing.
Apr 14 12:11:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474278.1321154, 9741284c-15ce-41e3-934d-bf8f46a407f5 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] VM Resumed (Lifecycle Event)
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:11:18 user nova-compute[71330]: WARNING nova.compute.manager [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state building and task_state spawning.
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance spawned successfully.
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474278.1545107, 9741284c-15ce-41e3-934d-bf8f46a407f5 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] VM Started (Lifecycle Event)
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.compute.manager [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Took 6.33 seconds to build instance.
Apr 14 12:11:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.499s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Instance destroyed successfully.
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Attempting a stable device rescue
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71330) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Instance directory exists: not creating {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 12:11:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Creating image(s)
Apr 14 12:11:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "/opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "/opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG nova.objects.instance [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "e4c01c1de309cc998394e6847600e93178e8c9f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "e4c01c1de309cc998394e6847600e93178e8c9f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6.part --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:11:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6.part --force-share --output=json" returned: 0 in 0.152s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:19 user nova-compute[71330]: DEBUG nova.virt.images [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 965e6d90-55dd-4a82-8b48-be9feeb0a867 was qcow2, converting to raw {{(pid=71330) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 12:11:19 user nova-compute[71330]: DEBUG nova.privsep.utils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71330) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 12:11:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6.part /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6.converted {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:11:20 user nova-compute[71330]: WARNING nova.compute.manager [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state active and task_state rescuing.
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6.part /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6.converted" returned: 0 in 0.497s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6.converted --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "e4c01c1de309cc998394e6847600e93178e8c9f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.610s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "e4c01c1de309cc998394e6847600e93178e8c9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "e4c01c1de309cc998394e6847600e93178e8c9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6 --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6 --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6,backing_fmt=raw /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6,backing_fmt=raw /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue" returned: 0 in 0.048s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "e4c01c1de309cc998394e6847600e93178e8c9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'migration_context' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Start _get_guest_xml network_info=[{"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "vif_mac": "fa:16:3e:ff:54:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '965e6d90-55dd-4a82-8b48-be9feeb0a867', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '01f2da6a-c6ef-4e42-a0be-6e957f138174', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKxFToAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b5b4cd5e-d786-4c51-978b-7ff76e21d1b2', 'attached_at': '', 'detached_at': '', 'volume_id': '619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 'serial': '619cf8ad-1c8f-46f7-9838-4ea7cbceb050'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'resources' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'numa_topology' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:20 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:11:20 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKxFToAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:11:20 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:11:20 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:11:20 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baffd83-1cde-4e7a-aeff-b775d0ea0004]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nKxFToAs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 12:11:20 user nova-compute[71330]: node.name = iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:11:20 user nova-compute[71330]: node.tpgt = -1
Apr 14 12:11:20 user nova-compute[71330]: node.startup = automatic
Apr 14 12:11:20 user nova-compute[71330]: node.leading_login = No
Apr 14 12:11:20 user nova-compute[71330]: iface.iscsi_ifacename = default
Apr 14 12:11:20 user nova-compute[71330]: iface.net_ifacename = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.ipaddress = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.prefix_len = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.hwaddress = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.transport_name = tcp
Apr 14 12:11:20 user nova-compute[71330]: iface.initiatorname = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.state = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.vlan_id = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.vlan_priority = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.vlan_state = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.iface_num = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.mtu = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.port = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.bootproto = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.subnet_mask = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.gateway = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.dhcp_alt_client_id = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.dhcp_dns = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.dhcp_learn_iqn = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.dhcp_vendor_id_state = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.dhcp_vendor_id = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.dhcp_slp_da = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.fragmentation = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.gratuitous_arp = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.incoming_forwarding = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.tos_state = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.tos = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.ttl = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.delayed_ack = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.tcp_nagle = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.tcp_wsf_state = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.tcp_wsf = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.tcp_timer_scale = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.tcp_timestamp = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.redirect = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.def_task_mgmt_timeout = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.header_digest = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.data_digest = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.immediate_data = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.initial_r2t = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.data_seq_inorder = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.data_pdu_inorder = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.erl = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.max_receive_data_len = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.first_burst_len = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.max_outstanding_r2t = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.max_burst_len = 0
Apr 14 12:11:20 user nova-compute[71330]: iface.chap_auth = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.bidi_chap = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.strict_login_compliance = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.discovery_auth = <empty>
Apr 14 12:11:20 user nova-compute[71330]: iface.discovery_logout = <empty>
Apr 14 12:11:20 user nova-compute[71330]: node.discovery_address = <empty>
Apr 14 12:11:20 user nova-compute[71330]: node.discovery_port = 0
Apr 14 12:11:20 user nova-compute[71330]: node.discovery_type = static
Apr 14 12:11:20 user nova-compute[71330]: node.session.initial_cmdsn = 0
Apr 14 12:11:20 user nova-compute[71330]: node.session.initial_login_retry_max = 8
Apr 14 12:11:20 user nova-compute[71330]: node.session.xmit_thread_priority = -20
Apr 14 12:11:20 user nova-compute[71330]: node.session.cmds_max = 128
Apr 14 12:11:20 user nova-compute[71330]: node.session.queue_depth = 32
Apr 14 12:11:20 user nova-compute[71330]: node.session.nr_sessions = 1
Apr 14 12:11:20 user nova-compute[71330]: node.session.auth.authmethod = CHAP
Apr 14 12:11:20 user nova-compute[71330]: node.session.auth.username = nKxFToAs
Apr 14 12:11:20 user nova-compute[71330]: node.session.auth.password = ***
Apr 14 12:11:20 user nova-compute[71330]: node.session.auth.username_in = <empty>
Apr 14 12:11:20 user nova-compute[71330]: node.session.auth.password_in = <empty>
Apr 14 12:11:20 user nova-compute[71330]: node.session.auth.chap_algs = MD5
Apr 14 12:11:20 user nova-compute[71330]: node.session.timeo.replacement_timeout = 120
Apr 14 12:11:20 user nova-compute[71330]: node.session.err_timeo.abort_timeout = 15
Apr 14 12:11:20 user nova-compute[71330]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 12:11:20 user nova-compute[71330]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 12:11:20 user nova-compute[71330]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.FastAbort = Yes
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.InitialR2T = No
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.ImmediateData = Yes
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.MaxConnections = 1
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 12:11:20 user nova-compute[71330]: node.session.iscsi.ERL = 0
Apr 14 12:11:20 user nova-compute[71330]: node.session.scan = manual
Apr 14 12:11:20 user nova-compute[71330]: node.session.reopen_max = 0
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].address = 172.16.0.220
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].port = 3260
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].startup = manual
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].tcp.window_size = 524288
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].tcp.type_of_service = 0
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].timeo.logout_timeout = 15
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].timeo.login_timeout = 15
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].timeo.auth_timeout = 45
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].iscsi.DataDigest = None
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].iscsi.IFMarker = No
Apr 14 12:11:20 user nova-compute[71330]: node.conn[0].iscsi.OFMarker = No
Apr 14 12:11:20 user nova-compute[71330]: # END RECORD
Apr 14 12:11:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bab2601-a013-4111-a1f8-76b930806507]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[730733a3-165c-456e-b232-f4ae46db2ec1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKxFToAs {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKxFToAs" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6c5978-8a90-421b-9172-75c234f50a5d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nKxFToAs'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d7b199-ad23-431f-b4f1-3645e15b38d6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce95a73a-c7b5-4c29-83c8-d4badc029fc9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:11:20 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:11:20 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:11:20 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:11:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:11:20 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:11:20 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:11:20 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:11:20 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] HCTL ('33', '0', '0', 0) found on session 29 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2865ee-b894-4441-a52a-5e9f17aef7a0]: (4, ('0 0 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Searching for a device in session 29 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKxFToAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23439376137353339', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439376137353339', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1172257873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1172257873',id=27,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-hbo3f45m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:09:44Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=b5b4cd5e-d786-4c51-978b-7ff76e21d1b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "vif_mac": "fa:16:3e:ff:54:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "vif_mac": "fa:16:3e:ff:54:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:54:50,bridge_name='br-int',has_traffic_filtering=True,id=6facec09-5fc6-423c-9c30-9a1ca2ea0d05,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6facec09-5f') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'pci_devices' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:20 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:11:20 user nova-compute[71330]:   <uuid>b5b4cd5e-d786-4c51-978b-7ff76e21d1b2</uuid>
Apr 14 12:11:20 user nova-compute[71330]:   <name>instance-0000001b</name>
Apr 14 12:11:20 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:11:20 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:11:20 user nova-compute[71330]:   <metadata>
Apr 14 12:11:20 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:11:20 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:11:20 user nova-compute[71330]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1172257873</nova:name>
Apr 14 12:11:20 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:11:20</nova:creationTime>
Apr 14 12:11:20 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:11:20 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:11:20 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:11:20 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:11:20 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:11:20 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:11:20 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:11:20 user nova-compute[71330]:       <nova:owner>
Apr 14 12:11:20 user nova-compute[71330]:         <nova:user uuid="11df88c60e4b456691d8731fe8facf38">tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member</nova:user>
Apr 14 12:11:20 user nova-compute[71330]:         <nova:project uuid="2c5140d4419e43be941c2ac5d5439e35">tempest-ServerBootFromVolumeStableRescueTest-1565599676</nova:project>
Apr 14 12:11:20 user nova-compute[71330]:       </nova:owner>
Apr 14 12:11:20 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:11:20 user nova-compute[71330]:       <nova:ports>
Apr 14 12:11:20 user nova-compute[71330]:         <nova:port uuid="6facec09-5fc6-423c-9c30-9a1ca2ea0d05">
Apr 14 12:11:20 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 12:11:20 user nova-compute[71330]:         </nova:port>
Apr 14 12:11:20 user nova-compute[71330]:       </nova:ports>
Apr 14 12:11:20 user nova-compute[71330]:     </nova:instance>
Apr 14 12:11:20 user nova-compute[71330]:   </metadata>
Apr 14 12:11:20 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:11:20 user nova-compute[71330]:     <system>
Apr 14 12:11:20 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:11:20 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:11:20 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:11:20 user nova-compute[71330]:       <entry name="serial">b5b4cd5e-d786-4c51-978b-7ff76e21d1b2</entry>
Apr 14 12:11:20 user nova-compute[71330]:       <entry name="uuid">b5b4cd5e-d786-4c51-978b-7ff76e21d1b2</entry>
Apr 14 12:11:20 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:11:20 user nova-compute[71330]:     </system>
Apr 14 12:11:20 user nova-compute[71330]:   </sysinfo>
Apr 14 12:11:20 user nova-compute[71330]:   <os>
Apr 14 12:11:20 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:11:20 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:11:20 user nova-compute[71330]:   </os>
Apr 14 12:11:20 user nova-compute[71330]:   <features>
Apr 14 12:11:20 user nova-compute[71330]:     <acpi/>
Apr 14 12:11:20 user nova-compute[71330]:     <apic/>
Apr 14 12:11:20 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:11:20 user nova-compute[71330]:   </features>
Apr 14 12:11:20 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:11:20 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:11:20 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:11:20 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:11:20 user nova-compute[71330]:   </clock>
Apr 14 12:11:20 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:11:20 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:11:20 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:11:20 user nova-compute[71330]:   </cpu>
Apr 14 12:11:20 user nova-compute[71330]:   <devices>
Apr 14 12:11:20 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:11:20 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:11:20 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 12:11:20 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:11:20 user nova-compute[71330]:       <serial>619cf8ad-1c8f-46f7-9838-4ea7cbceb050</serial>
Apr 14 12:11:20 user nova-compute[71330]:     </disk>
Apr 14 12:11:20 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:11:20 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:11:20 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue"/>
Apr 14 12:11:20 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:11:20 user nova-compute[71330]:       <boot order="1"/>
Apr 14 12:11:20 user nova-compute[71330]:     </disk>
Apr 14 12:11:20 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:11:20 user nova-compute[71330]:       <mac address="fa:16:3e:ff:54:50"/>
Apr 14 12:11:20 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:11:20 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:11:20 user nova-compute[71330]:       <target dev="tap6facec09-5f"/>
Apr 14 12:11:20 user nova-compute[71330]:     </interface>
Apr 14 12:11:20 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:11:20 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/console.log" append="off"/>
Apr 14 12:11:20 user nova-compute[71330]:     </serial>
Apr 14 12:11:20 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:11:20 user nova-compute[71330]:     <video>
Apr 14 12:11:20 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:11:20 user nova-compute[71330]:     </video>
Apr 14 12:11:20 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:11:20 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:11:20 user nova-compute[71330]:     </rng>
Apr 14 12:11:20 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:11:20 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:11:20 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:11:20 user nova-compute[71330]:     </memballoon>
Apr 14 12:11:20 user nova-compute[71330]:   </devices>
Apr 14 12:11:20 user nova-compute[71330]: </domain>
Apr 14 12:11:20 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:11:21 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Instance destroyed successfully.
Apr 14 12:11:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:11:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:11:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] No VIF found with MAC fa:16:3e:ff:54:50, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:11:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:22 user nova-compute[71330]: DEBUG nova.compute.manager [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:22 user nova-compute[71330]: DEBUG nova.compute.manager [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:11:22 user nova-compute[71330]: WARNING nova.compute.manager [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state active and task_state rescuing.
Apr 14 12:11:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:11:24 user nova-compute[71330]: WARNING nova.compute.manager [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state active and task_state rescuing.
Apr 14 12:11:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474284.8970208, b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:11:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] VM Resumed (Lifecycle Event)
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:11:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474284.8988953, b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:11:24 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] VM Started (Lifecycle Event)
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:11:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:11:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:11:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:11:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:11:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:11:49 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:11:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:50 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updating instance_info_cache with network_info: [{"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:11:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:11:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:11:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:11:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:11:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:11:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:11:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:11:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:11:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:11:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received event network-changed-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Refreshing instance network info cache due to event network-changed-d1f86382-dd60-47d2-afae-5bbfd54c7489. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:11:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] Acquiring lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:11:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] Acquired lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:11:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Refreshing network info cache for port d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:11:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:53 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:11:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG nova.network.neutron [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updated VIF entry in instance network info cache for port d1f86382-dd60-47d2-afae-5bbfd54c7489. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG nova.network.neutron [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating instance_info_cache with network_info: [{"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] Releasing lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:54 user nova-compute[71330]: INFO nova.compute.manager [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attaching volume 024cd216-6cc1-4d77-b289-271450a7fe62 to /dev/vdb
Apr 14 12:11:54 user nova-compute[71330]: DEBUG os_brick.utils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2f8de8-d770-4736-8df8-9efdb578b261]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ecd680-36a8-4239-a251-529055099d8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2684c6ed-3cf7-4086-88b0-2408d7ee8716]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1cb5c-ee51-48ee-8853-f061dc99eef0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:11:54 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:11:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acfe79b-cc4b-47e3-bfdc-1a6c7bf3b8d1]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG os_brick.utils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating existing volume attachment record: 3c5fc878-ad6c-4fdb-b9cd-a41411a88ce9 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:11:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:11:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:57 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:11:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:57 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUzDKpmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:11:58 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:11:58 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:11:58 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f62f4c-410b-4a65-a500-dc98eae58e0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:11:58 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce004076-929f-4679-8a95-45bdcde675bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62] added
Apr 14 12:11:58 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[465bbe05-adf0-4217-97f4-41d0c6a30eef]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[20afaf2a-6cc6-46af-bb15-77162217560c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUzDKpmF {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUzDKpmF" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b90993-07f2-4324-94cd-5f8ff469a008]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sUzDKpmF'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[06650ed2-6e33-4793-ae11-b67d7706ea6a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ccf2e9-7731-415d-b93d-3130e10b88a3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:11:58 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:11:58 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:11:58 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:11:58 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:11:58 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:11:58 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:11:58 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:11:58 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:11:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50c5201-bf29-4b3b-adae-1d75a9b7bced]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62, portal: 172.16.0.220,3260]
Apr 14 12:11:59 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62, portal: 172.16.0.220,3260] successful.
Apr 14 12:11:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b3abd-dc82-4f4f-b16c-12100c787057]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2781f9-c6cb-4d48-8028-1ab378b526c7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:11:59 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:11:59 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:11:59 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:11:59 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:11:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:11:59 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:11:59 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:11:59 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:11:59 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:11:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d2edf8-bfc7-415c-aa01-574dd27d3f15]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUzDKpmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:59 user nova-compute[71330]: INFO nova.compute.manager [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Terminating instance
Apr 14 12:11:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG nova.compute.manager [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-unplugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG nova.compute.manager [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-unplugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG nova.compute.manager [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-unplugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:11:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:00 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Instance destroyed successfully.
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.objects.instance [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'resources' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1425077184',display_name='tempest-ServerRescueNegativeTestJSON-server-1425077184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1425077184',id=23,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChwBqnED/n2nWrN2SoLSMRhqkE84LnQSbYpaeWVgLfUiXzTqQT/5YeOR1ydLbZ836JaTZWc0GepItYuqZ/dHFeEKlQx8bHxyYpEaXK0Bnde9kYWx5+wzLpg/aD1Yl4K9A==',key_name='tempest-keypair-1239489635',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-x76brrrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=4595c0e6-f2af-47ef-b26e-7b1ccb58aa47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "address": "fa:16:3e:5e:c2:00", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9407c-34", "ovs_interfaceid": "3ba9407c-344c-45b8-a483-36e0c0e72ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c2:00,bridge_name='br-int',has_traffic_filtering=True,id=3ba9407c-344c-45b8-a483-36e0c0e72ff0,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9407c-34') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG os_vif [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c2:00,bridge_name='br-int',has_traffic_filtering=True,id=3ba9407c-344c-45b8-a483-36e0c0e72ff0,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9407c-34') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ba9407c-34, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:12:00 user nova-compute[71330]: INFO os_vif [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c2:00,bridge_name='br-int',has_traffic_filtering=True,id=3ba9407c-344c-45b8-a483-36e0c0e72ff0,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9407c-34')
Apr 14 12:12:00 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Deleting instance files /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47_del
Apr 14 12:12:00 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Deletion of /opt/stack/data/nova/instances/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47_del complete
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:00 user nova-compute[71330]: INFO nova.compute.manager [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23836386262663866', 'path': '/dev/sdf'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836386262663866', 'path': '/dev/sdf'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.objects.instance [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:12:00 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:12:00 user nova-compute[71330]:   <source dev="/dev/sdf"/>
Apr 14 12:12:00 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:12:00 user nova-compute[71330]:   <serial>024cd216-6cc1-4d77-b289-271450a7fe62</serial>
Apr 14 12:12:00 user nova-compute[71330]: </disk>
Apr 14 12:12:00 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No VIF found with MAC fa:16:3e:b2:30:0b, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.725s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.manager [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-deleted-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:01 user nova-compute[71330]: INFO nova.compute.manager [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Neutron deleted interface 3ba9407c-344c-45b8-a483-36e0c0e72ff0; detaching it from the instance and deleting it from the info cache
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.network.neutron [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:12:01 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:12:01 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7720MB free_disk=26.027244567871094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.manager [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Detach interface failed, port_id=3ba9407c-344c-45b8-a483-36e0c0e72ff0, reason: Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:12:01 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Took 1.33 seconds to deallocate network for instance.
Apr 14 12:12:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.manager [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] Acquiring lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.manager [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] No waiting events found dispatching network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:01 user nova-compute[71330]: WARNING nova.compute.manager [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Received unexpected event network-vif-plugged-3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance with vm_state deleted and task_state None.
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Applying migration context for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f as it has an incoming, in-progress migration 463dbd5c-8d7d-4231-906e-0ce37590969c. Migration status is finished {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 12:12:01 user nova-compute[71330]: INFO nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating resource usage from migration 463dbd5c-8d7d-4231-906e-0ce37590969c
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 545be51c-649c-4297-a924-bbb6ecf303dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Migration 463dbd5c-8d7d-4231-906e-0ce37590969c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.442s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:02 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:12:02 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:12:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:02 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Deleted allocations for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47
Apr 14 12:12:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.255s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Port d7cd0790-d778-4855-b7ad-c0b5c0258c1b binding to destination host user is already ACTIVE {{(pid=71330) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 12:12:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:12:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:12:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Creating tmpfile /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/tmpegcqwh8f to verify with other compute node that the instance is on the same shared storage. {{(pid=71330) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG nova.compute.manager [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG nova.compute.manager [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:03 user nova-compute[71330]: WARNING nova.compute.manager [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state resized and task_state resize_reverting.
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:03 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance destroyed successfully.
Apr 14 12:12:03 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'resources' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG os_vif [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:12:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7cd0790-d7, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:12:04 user nova-compute[71330]: INFO os_vif [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7')
Apr 14 12:12:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:12:04 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb5415c-7be8-4e70-ac65-880d0de967ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:12:04 user nova-compute[71330]: No targets found.
Apr 14 12:12:04 user nova-compute[71330]: iSNS:
Apr 14 12:12:04 user nova-compute[71330]: No targets found.
Apr 14 12:12:04 user nova-compute[71330]: STATIC:
Apr 14 12:12:04 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:12:04 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:04 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:04 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62
Apr 14 12:12:04 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:04 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:04 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b
Apr 14 12:12:04 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:04 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:04 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:12:04 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:04 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:04 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07
Apr 14 12:12:04 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:04 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:04 user nova-compute[71330]: FIRMWARE:
Apr 14 12:12:04 user nova-compute[71330]: No targets found.
Apr 14 12:12:04 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:12:04 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:12:04 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b3648a-f659-4f26-bf9f-53ee3384c1a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fa3ccb-c74c-48f6-a4d5-a6d8329a1ed5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:04 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:04 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:04 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:04 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:12:04 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:04 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:04 user nova-compute[71330]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:04 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:04 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:12:04 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962cb32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7a6619-29fb-473d-afa4-a896f8122f3f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5d9cff-c09e-4fce-86b9-c2a4d7de2d9b]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[62903620-cde2-486d-b0a0-d3ae63d7c221]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[157638ec-11cb-4a2d-a836-d48b8b357acc]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d05be49-88b9-439f-82ca-601c64fc2156]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1622fd88-1d23-4ee1-b59f-a695f927942f]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]
Apr 14 12:12:04 user nova-compute[71330]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.
Apr 14 12:12:04 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[686162bc-494d-49bb-b331-383e6447b31b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== disconnect_volume: return (364ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'migration_context' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:05 user nova-compute[71330]: WARNING nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state resized and task_state resize_reverting.
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:05 user nova-compute[71330]: WARNING nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state resized and task_state resize_reverting.
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:05 user nova-compute[71330]: WARNING nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state resized and task_state resize_reverting.
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:05 user nova-compute[71330]: WARNING nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state resized and task_state resize_reverting.
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:05 user nova-compute[71330]: WARNING nova.compute.manager [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state resized and task_state resize_reverting.
Apr 14 12:12:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.403s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:05 user nova-compute[71330]: INFO nova.compute.manager [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Swapping old allocation on dict_keys(['e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0']) held by migration 463dbd5c-8d7d-4231-906e-0ce37590969c for instance
Apr 14 12:12:05 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Overwriting current allocation {'allocations': {'e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 36}}, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'consumer_generation': 1} on consumer 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG os_brick.utils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb8eb64-2255-49c4-be70-cd1c0d545814]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3980f761-d0f4-4f60-99b4-3af9506e4898]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a80062-b192-449c-b9e3-e8de2b2b4bc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4ce016-4656-4c67-ab29-c72a179b9eb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:12:06 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:12:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d5296a-8d10-48cc-8612-cb6bd20a2fbb]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:12:06 user nova-compute[71330]: DEBUG os_brick.utils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:12:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:13 user nova-compute[71330]: INFO nova.compute.manager [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Detaching volume 024cd216-6cc1-4d77-b289-271450a7fe62
Apr 14 12:12:13 user nova-compute[71330]: INFO nova.virt.block_device [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attempting to driver detach volume 024cd216-6cc1-4d77-b289-271450a7fe62 from mountpoint /dev/vdb
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Attempting to detach device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:12:13 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:12:13 user nova-compute[71330]:   <source dev="/dev/sdf"/>
Apr 14 12:12:13 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:12:13 user nova-compute[71330]:   <serial>024cd216-6cc1-4d77-b289-271450a7fe62</serial>
Apr 14 12:12:13 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:12:13 user nova-compute[71330]: </disk>
Apr 14 12:12:13 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:12:13 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully detached device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the persistent domain config.
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:12:13 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:12:13 user nova-compute[71330]:   <source dev="/dev/sdf"/>
Apr 14 12:12:13 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:12:13 user nova-compute[71330]:   <serial>024cd216-6cc1-4d77-b289-271450a7fe62</serial>
Apr 14 12:12:13 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:12:13 user nova-compute[71330]: </disk>
Apr 14 12:12:13 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Starting finish_revert_migration {{(pid=71330) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Start _get_guest_xml network_info=[{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'b9a61a35-b8ef-41de-a92a-9294503b6467', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '11e4aa91-7c03-46cc-8610-78f18bbd089f', 'attached_at': '2023-04-14T12:12:13.000000', 'detached_at': '', 'volume_id': 'e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'serial': 'e42f9d56-b181-465a-9ed8-ef4b1f47832b'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:12:13 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:12:13 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:12:13 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:12:13 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:12:13 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474333.857722, a83e502a-7b98-4a46-ae3d-82339fbf07ca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:13 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully detached device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the live domain config.
Apr 14 12:12:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUzDKpmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:12:13 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260" returned: 21 in 0.065s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce59832-78fa-40cf-a672-f3cc3e3238a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:12:13 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4b4fde-250a-4b66-8d37-3e5832b39cfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b] added
Apr 14 12:12:13 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fcd383-eb79-4c5e-957e-fc0c6b811191]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc5fba-ef83-413e-aeef-7fefc133de7d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYGzSdrA {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYGzSdrA" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9056d5b6-96bc-4ab4-91dd-6f7a05491566]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYGzSdrA'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcd7a6b-a690-479d-a91c-f28eb27c28dc]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d42ca9c-3b58-4f61-8c9a-4d8798cd2f22]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d07193-e6c4-412d-85ba-b4dac65d45c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]
Apr 14 12:12:14 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.
Apr 14 12:12:14 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b700e3b-5937-4c49-8aae-9ab40016804e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c2d5c0-bcb6-42a3-8701-01e4c19a8488]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:14 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:12:14 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:14 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[be43eff1-d8d9-41b7-b729-21e68ed30145]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:12:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474320.003047, 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:12:15 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] VM Stopped (Lifecycle Event)
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-801f7c90-5b56-4929-904a-a579bf8c527f None None] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23061626362663933', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061626362663933', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.367s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:12:15 user nova-compute[71330]:   <uuid>11e4aa91-7c03-46cc-8610-78f18bbd089f</uuid>
Apr 14 12:12:15 user nova-compute[71330]:   <name>instance-0000000f</name>
Apr 14 12:12:15 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:12:15 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:12:15 user nova-compute[71330]:   <metadata>
Apr 14 12:12:15 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:12:15 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:12:15 user nova-compute[71330]:       <nova:name>tempest-ServerActionsTestJSON-server-451636587</nova:name>
Apr 14 12:12:15 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:12:13</nova:creationTime>
Apr 14 12:12:15 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:12:15 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:12:15 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:12:15 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:12:15 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:12:15 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:12:15 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:12:15 user nova-compute[71330]:       <nova:owner>
Apr 14 12:12:15 user nova-compute[71330]:         <nova:user uuid="7e264a59ff9b42e08095d0ce71e4d627">tempest-ServerActionsTestJSON-1592133549-project-member</nova:user>
Apr 14 12:12:15 user nova-compute[71330]:         <nova:project uuid="3e4ff63247dd4535bcd86acfde76fd34">tempest-ServerActionsTestJSON-1592133549</nova:project>
Apr 14 12:12:15 user nova-compute[71330]:       </nova:owner>
Apr 14 12:12:15 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:12:15 user nova-compute[71330]:       <nova:ports>
Apr 14 12:12:15 user nova-compute[71330]:         <nova:port uuid="d7cd0790-d778-4855-b7ad-c0b5c0258c1b">
Apr 14 12:12:15 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 12:12:15 user nova-compute[71330]:         </nova:port>
Apr 14 12:12:15 user nova-compute[71330]:       </nova:ports>
Apr 14 12:12:15 user nova-compute[71330]:     </nova:instance>
Apr 14 12:12:15 user nova-compute[71330]:   </metadata>
Apr 14 12:12:15 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:12:15 user nova-compute[71330]:     <system>
Apr 14 12:12:15 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:12:15 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:12:15 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:12:15 user nova-compute[71330]:       <entry name="serial">11e4aa91-7c03-46cc-8610-78f18bbd089f</entry>
Apr 14 12:12:15 user nova-compute[71330]:       <entry name="uuid">11e4aa91-7c03-46cc-8610-78f18bbd089f</entry>
Apr 14 12:12:15 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:12:15 user nova-compute[71330]:     </system>
Apr 14 12:12:15 user nova-compute[71330]:   </sysinfo>
Apr 14 12:12:15 user nova-compute[71330]:   <os>
Apr 14 12:12:15 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:12:15 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:12:15 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:12:15 user nova-compute[71330]:   </os>
Apr 14 12:12:15 user nova-compute[71330]:   <features>
Apr 14 12:12:15 user nova-compute[71330]:     <acpi/>
Apr 14 12:12:15 user nova-compute[71330]:     <apic/>
Apr 14 12:12:15 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:12:15 user nova-compute[71330]:   </features>
Apr 14 12:12:15 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:12:15 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:12:15 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:12:15 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:12:15 user nova-compute[71330]:   </clock>
Apr 14 12:12:15 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:12:15 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:12:15 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:12:15 user nova-compute[71330]:   </cpu>
Apr 14 12:12:15 user nova-compute[71330]:   <devices>
Apr 14 12:12:15 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:12:15 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:12:15 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk"/>
Apr 14 12:12:15 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:12:15 user nova-compute[71330]:     </disk>
Apr 14 12:12:15 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:12:15 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:12:15 user nova-compute[71330]:       <source dev="/dev/sdc"/>
Apr 14 12:12:15 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:12:15 user nova-compute[71330]:       <serial>e42f9d56-b181-465a-9ed8-ef4b1f47832b</serial>
Apr 14 12:12:15 user nova-compute[71330]:     </disk>
Apr 14 12:12:15 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:12:15 user nova-compute[71330]:       <mac address="fa:16:3e:e5:db:94"/>
Apr 14 12:12:15 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:12:15 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:12:15 user nova-compute[71330]:       <target dev="tapd7cd0790-d7"/>
Apr 14 12:12:15 user nova-compute[71330]:     </interface>
Apr 14 12:12:15 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:12:15 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/console.log" append="off"/>
Apr 14 12:12:15 user nova-compute[71330]:     </serial>
Apr 14 12:12:15 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:12:15 user nova-compute[71330]:     <video>
Apr 14 12:12:15 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:12:15 user nova-compute[71330]:     </video>
Apr 14 12:12:15 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:12:15 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:12:15 user nova-compute[71330]:     </rng>
Apr 14 12:12:15 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:12:15 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:12:15 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:12:15 user nova-compute[71330]:     </memballoon>
Apr 14 12:12:15 user nova-compute[71330]:   </devices>
Apr 14 12:12:15 user nova-compute[71330]: </domain>
Apr 14 12:12:15 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_vif [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[da58bb8a-4c5a-4807-8d52-717f182ad747]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:12:15 user nova-compute[71330]: No targets found.
Apr 14 12:12:15 user nova-compute[71330]: iSNS:
Apr 14 12:12:15 user nova-compute[71330]: No targets found.
Apr 14 12:12:15 user nova-compute[71330]: STATIC:
Apr 14 12:12:15 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:12:15 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:15 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:15 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62
Apr 14 12:12:15 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:15 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:15 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b
Apr 14 12:12:15 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:15 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:15 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:12:15 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:15 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:15 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07
Apr 14 12:12:15 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:12:15 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:12:15 user nova-compute[71330]: FIRMWARE:
Apr 14 12:12:15 user nova-compute[71330]: No targets found.
Apr 14 12:12:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:12:15 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:12:15 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7cd0790-d7, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7cd0790-d7, col_values=(('external_ids', {'iface-id': 'd7cd0790-d778-4855-b7ad-c0b5c0258c1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:db:94', 'vm-uuid': '11e4aa91-7c03-46cc-8610-78f18bbd089f'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:15 user nova-compute[71330]: INFO os_vif [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7')
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4142618b-cc85-4e4a-b8ba-45f09e73a714]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e863f418-a72d-438d-a9d6-c215bb145b42]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:15 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:15 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:15 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:12:15 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:15 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:15 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:15 user nova-compute[71330]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 (non-flash)
Apr 14 12:12:15 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c2c32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62'): ({'sdf'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Removing single pathed devices sdf {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c698bd-4c31-4033-a5b1-8b708b8ee3c0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe22d69-1524-40b1-b7da-ac1237b54582]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Flushing IO for device /dev/sdf {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[91768423-28ac-4cde-a506-a1349fa0baa5]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[14228588-29aa-4bb2-873b-2dc4ad089c5b]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f84c7-f164-4630-8a7b-46d66f67522a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9041fb29-d617-4c14-9a58-ac2d56a39a54]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62, portal: 172.16.0.220,3260]
Apr 14 12:12:15 user nova-compute[71330]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62, portal: 172.16.0.220,3260] successful.
Apr 14 12:12:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024cd216-6cc1-4d77-b289-271450a7fe62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a7ce9f-dae5-41f7-8704-718965afcef2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== disconnect_volume: return (1695ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:12:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG nova.objects.instance [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.224s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:16 user nova-compute[71330]: WARNING nova.compute.manager [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state resized and task_state resize_reverting.
Apr 14 12:12:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "c659b3a7-fdf1-4513-8202-770d21f731b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:12:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:12:17 user nova-compute[71330]: INFO nova.compute.claims [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Claim successful on node user
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:12:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:12:18 user nova-compute[71330]: INFO nova.virt.block_device [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Booting with volume snapshot 105d85cc-e8ed-4bbb-b801-c91707eeafd6 at /dev/vda
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.policy [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 11e4aa91-7c03-46cc-8610-78f18bbd089f due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474338.8285263, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:12:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Resumed (Lifecycle Event)
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:12:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance running successfully.
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] finish_revert_migration finished successfully. {{(pid=71330) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:12:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474338.8296127, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:12:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Started (Lifecycle Event)
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:12:18 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:18 user nova-compute[71330]: WARNING nova.compute.manager [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state resized and task_state resize_reverting.
Apr 14 12:12:19 user nova-compute[71330]: INFO nova.compute.manager [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance to original state: 'active'
Apr 14 12:12:19 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Successfully created port: 74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:12:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:19 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Successfully updated port: 74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:12:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "refresh_cache-c659b3a7-fdf1-4513-8202-770d21f731b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:12:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquired lock "refresh_cache-c659b3a7-fdf1-4513-8202-770d21f731b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:12:19 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:12:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received event network-changed-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Refreshing instance network info cache due to event network-changed-74de70a0-4308-49c6-bef0-449f745b6085. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:12:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] Acquiring lock "refresh_cache-c659b3a7-fdf1-4513-8202-770d21f731b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:12:19 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:12:20 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Updating instance_info_cache with network_info: [{"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:12:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Releasing lock "refresh_cache-c659b3a7-fdf1-4513-8202-770d21f731b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:12:20 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Instance network_info: |[{"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:12:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] Acquired lock "refresh_cache-c659b3a7-fdf1-4513-8202-770d21f731b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:12:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Refreshing network info cache for port 74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:12:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Updated VIF entry in instance network info cache for port 74de70a0-4308-49c6-bef0-449f745b6085. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:12:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Updating instance_info_cache with network_info: [{"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:12:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] Releasing lock "refresh_cache-c659b3a7-fdf1-4513-8202-770d21f731b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG os_brick.utils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fbac95-1747-4254-a035-aa5672d115c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.042s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c4cab-a252-490a-a926-9782705479cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa5c62d-2996-42fd-9b59-bcc69d75a776]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0439c39-b153-4c0d-828c-780db20de5f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:12:24 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:12:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[886d2328-bf2c-4467-83c2-baef44f1ffc6]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG os_brick.utils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Updating existing volume attachment record: bc9ab13b-8d1a-4364-ad0f-ad7f2745005e {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:12:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:12:29 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Creating image(s)
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Ensure instance console log exists: /opt/stack/data/nova/instances/c659b3a7-fdf1-4513-8202-770d21f731b2/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Start _get_guest_xml network_info=[{"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T12:12:14Z,direct_url=<?>,disk_format='qcow2',id=30788121-99e9-48c7-9bac-0c68400ba1d3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1913474144',owner='0c317cb8d6a44115b216678540c433b6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T12:12:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'bc9ab13b-8d1a-4364-ad0f-ad7f2745005e', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efpomYOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c659b3a7-fdf1-4513-8202-770d21f731b2', 'attached_at': '', 'detached_at': '', 'volume_id': '1734b42f-80c5-4abc-9a00-cd6a1f7ead95', 'serial': '1734b42f-80c5-4abc-9a00-cd6a1f7ead95'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:12:29 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:12:29 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T12:12:14Z,direct_url=<?>,disk_format='qcow2',id=30788121-99e9-48c7-9bac-0c68400ba1d3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1913474144',owner='0c317cb8d6a44115b216678540c433b6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T12:12:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efpomYOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:12:29 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:12:29 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:12:29 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[26224167-8ebe-4eff-94d8-78289d5f5b5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:12:29 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f4e238-44e0-453e-b381-64db458805fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95] added
Apr 14 12:12:29 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f343e1-44f9-43e2-a025-c5e46c652cd5]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3809d0-8870-4f09-8cc7-63b4c0d69e52]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efpomYOJ {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efpomYOJ" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c97bef8-6454-4073-91f4-3a2ee9983991]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'efpomYOJ'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e3c6cf-cbd2-42e2-bf39-b29f7c4b9e10]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9411e6-4b0d-4bbe-9729-f5103cfbacfc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:29 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:29 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e022f9-cad9-4d17-ae2d-04d10e354978]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95, portal: 172.16.0.220,3260]
Apr 14 12:12:29 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95, portal: 172.16.0.220,3260] successful.
Apr 14 12:12:29 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4834f345-e823-4084-aa00-d3d977926bab]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a64141-3efd-4178-bfd4-95bf681359ce]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:12:29 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:12:29 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3316bd4-a011-4c27-953d-2addd499523b]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:12:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efpomYOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23363623239316538', 'path': '/dev/sdf'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363623239316538', 'path': '/dev/sdf'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1534345749',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1534345749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1534345749',id=31,image_ref='30788121-99e9-48c7-9bac-0c68400ba1d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-oaz3hi1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2042813947',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:12:18Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=c659b3a7-fdf1-4513-8202-770d21f731b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:4c:4e,bridge_name='br-int',has_traffic_filtering=True,id=74de70a0-4308-49c6-bef0-449f745b6085,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de70a0-43') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'pci_devices' on Instance uuid c659b3a7-fdf1-4513-8202-770d21f731b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:12:30 user nova-compute[71330]:   <uuid>c659b3a7-fdf1-4513-8202-770d21f731b2</uuid>
Apr 14 12:12:30 user nova-compute[71330]:   <name>instance-0000001f</name>
Apr 14 12:12:30 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:12:30 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:12:30 user nova-compute[71330]:   <metadata>
Apr 14 12:12:30 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:12:30 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:12:30 user nova-compute[71330]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1534345749</nova:name>
Apr 14 12:12:30 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:12:29</nova:creationTime>
Apr 14 12:12:30 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:12:30 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:12:30 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:12:30 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:12:30 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:12:30 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:12:30 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:12:30 user nova-compute[71330]:       <nova:owner>
Apr 14 12:12:30 user nova-compute[71330]:         <nova:user uuid="511fd95d993e4837a4a612385b04fdcb">tempest-TestVolumeBootPattern-2042813947-project-member</nova:user>
Apr 14 12:12:30 user nova-compute[71330]:         <nova:project uuid="0c317cb8d6a44115b216678540c433b6">tempest-TestVolumeBootPattern-2042813947</nova:project>
Apr 14 12:12:30 user nova-compute[71330]:       </nova:owner>
Apr 14 12:12:30 user nova-compute[71330]:       <nova:root type="image" uuid="30788121-99e9-48c7-9bac-0c68400ba1d3"/>
Apr 14 12:12:30 user nova-compute[71330]:       <nova:ports>
Apr 14 12:12:30 user nova-compute[71330]:         <nova:port uuid="74de70a0-4308-49c6-bef0-449f745b6085">
Apr 14 12:12:30 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 12:12:30 user nova-compute[71330]:         </nova:port>
Apr 14 12:12:30 user nova-compute[71330]:       </nova:ports>
Apr 14 12:12:30 user nova-compute[71330]:     </nova:instance>
Apr 14 12:12:30 user nova-compute[71330]:   </metadata>
Apr 14 12:12:30 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:12:30 user nova-compute[71330]:     <system>
Apr 14 12:12:30 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:12:30 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:12:30 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:12:30 user nova-compute[71330]:       <entry name="serial">c659b3a7-fdf1-4513-8202-770d21f731b2</entry>
Apr 14 12:12:30 user nova-compute[71330]:       <entry name="uuid">c659b3a7-fdf1-4513-8202-770d21f731b2</entry>
Apr 14 12:12:30 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:12:30 user nova-compute[71330]:     </system>
Apr 14 12:12:30 user nova-compute[71330]:   </sysinfo>
Apr 14 12:12:30 user nova-compute[71330]:   <os>
Apr 14 12:12:30 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:12:30 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:12:30 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:12:30 user nova-compute[71330]:   </os>
Apr 14 12:12:30 user nova-compute[71330]:   <features>
Apr 14 12:12:30 user nova-compute[71330]:     <acpi/>
Apr 14 12:12:30 user nova-compute[71330]:     <apic/>
Apr 14 12:12:30 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:12:30 user nova-compute[71330]:   </features>
Apr 14 12:12:30 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:12:30 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:12:30 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:12:30 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:12:30 user nova-compute[71330]:   </clock>
Apr 14 12:12:30 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:12:30 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:12:30 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:12:30 user nova-compute[71330]:   </cpu>
Apr 14 12:12:30 user nova-compute[71330]:   <devices>
Apr 14 12:12:30 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:12:30 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:12:30 user nova-compute[71330]:       <source dev="/dev/sdf"/>
Apr 14 12:12:30 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:12:30 user nova-compute[71330]:       <serial>1734b42f-80c5-4abc-9a00-cd6a1f7ead95</serial>
Apr 14 12:12:30 user nova-compute[71330]:     </disk>
Apr 14 12:12:30 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:12:30 user nova-compute[71330]:       <mac address="fa:16:3e:1c:4c:4e"/>
Apr 14 12:12:30 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:12:30 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:12:30 user nova-compute[71330]:       <target dev="tap74de70a0-43"/>
Apr 14 12:12:30 user nova-compute[71330]:     </interface>
Apr 14 12:12:30 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:12:30 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/c659b3a7-fdf1-4513-8202-770d21f731b2/console.log" append="off"/>
Apr 14 12:12:30 user nova-compute[71330]:     </serial>
Apr 14 12:12:30 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:12:30 user nova-compute[71330]:     <video>
Apr 14 12:12:30 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:12:30 user nova-compute[71330]:     </video>
Apr 14 12:12:30 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:12:30 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:12:30 user nova-compute[71330]:     </rng>
Apr 14 12:12:30 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:12:30 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:12:30 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:12:30 user nova-compute[71330]:     </memballoon>
Apr 14 12:12:30 user nova-compute[71330]:   </devices>
Apr 14 12:12:30 user nova-compute[71330]: </domain>
Apr 14 12:12:30 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1534345749',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1534345749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1534345749',id=31,image_ref='30788121-99e9-48c7-9bac-0c68400ba1d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-oaz3hi1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2042813947',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:12:18Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=c659b3a7-fdf1-4513-8202-770d21f731b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:4c:4e,bridge_name='br-int',has_traffic_filtering=True,id=74de70a0-4308-49c6-bef0-449f745b6085,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de70a0-43') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG os_vif [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:4c:4e,bridge_name='br-int',has_traffic_filtering=True,id=74de70a0-4308-49c6-bef0-449f745b6085,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de70a0-43') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74de70a0-43, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74de70a0-43, col_values=(('external_ids', {'iface-id': '74de70a0-4308-49c6-bef0-449f745b6085', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:4c:4e', 'vm-uuid': 'c659b3a7-fdf1-4513-8202-770d21f731b2'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:12:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:30 user nova-compute[71330]: INFO os_vif [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:4c:4e,bridge_name='br-int',has_traffic_filtering=True,id=74de70a0-4308-49c6-bef0-449f745b6085,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de70a0-43')
Apr 14 12:12:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:12:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No VIF found with MAC fa:16:3e:1c:4c:4e, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:12:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received event network-vif-plugged-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] Acquiring lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] No waiting events found dispatching network-vif-plugged-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:32 user nova-compute[71330]: WARNING nova.compute.manager [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received unexpected event network-vif-plugged-74de70a0-4308-49c6-bef0-449f745b6085 for instance with vm_state building and task_state spawning.
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received event network-vif-plugged-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] Acquiring lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] No waiting events found dispatching network-vif-plugged-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:34 user nova-compute[71330]: WARNING nova.compute.manager [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received unexpected event network-vif-plugged-74de70a0-4308-49c6-bef0-449f745b6085 for instance with vm_state building and task_state spawning.
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474354.6670306, c659b3a7-fdf1-4513-8202-770d21f731b2 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:12:34 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] VM Resumed (Lifecycle Event)
Apr 14 12:12:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:12:34 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Instance spawned successfully.
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:12:34 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474354.6675613, c659b3a7-fdf1-4513-8202-770d21f731b2 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:12:34 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] VM Started (Lifecycle Event)
Apr 14 12:12:34 user nova-compute[71330]: INFO nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:12:34 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:12:34 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:12:34 user nova-compute[71330]: INFO nova.compute.manager [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Took 17.05 seconds to build instance.
Apr 14 12:12:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.176s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:12:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:12:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:12:48 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:12:49 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updating instance_info_cache with network_info: [{"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:12:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-fcd74f51-099e-4c19-af7d-912f622fb153" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:12:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:12:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 12:12:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] There are 0 instances to clean {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 12:12:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:50 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:12:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:57 user nova-compute[71330]: INFO nova.compute.manager [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Terminating instance
Apr 14 12:12:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-unplugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] No waiting events found dispatching network-vif-unplugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-unplugged-e5175890-c267-454b-b532-70223beb1f72 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Instance destroyed successfully.
Apr 14 12:12:57 user nova-compute[71330]: DEBUG nova.objects.instance [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'resources' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1361327346',display_name='tempest-ServerRescueNegativeTestJSON-server-1361327346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1361327346',id=3,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:58:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-30rb8yo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:58:52Z,user_data=None,user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=68f7b119-b1c9-47ce-b325-5a4730aef707,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "e5175890-c267-454b-b532-70223beb1f72", "address": "fa:16:3e:66:90:02", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5175890-c2", "ovs_interfaceid": "e5175890-c267-454b-b532-70223beb1f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:90:02,bridge_name='br-int',has_traffic_filtering=True,id=e5175890-c267-454b-b532-70223beb1f72,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5175890-c2') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG os_vif [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:90:02,bridge_name='br-int',has_traffic_filtering=True,id=e5175890-c267-454b-b532-70223beb1f72,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5175890-c2') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5175890-c2, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:12:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:12:57 user nova-compute[71330]: INFO os_vif [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:90:02,bridge_name='br-int',has_traffic_filtering=True,id=e5175890-c267-454b-b532-70223beb1f72,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5175890-c2')
Apr 14 12:12:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Deleting instance files /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707_del
Apr 14 12:12:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Deletion of /opt/stack/data/nova/instances/68f7b119-b1c9-47ce-b325-5a4730aef707_del complete
Apr 14 12:12:58 user nova-compute[71330]: INFO nova.compute.manager [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 12:12:58 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:12:58 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Took 0.47 seconds to deallocate network for instance.
Apr 14 12:12:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-94644164-e756-4d08-91e6-e49552f9e8fc req-8670d5d0-1b8a-414c-9372-020c25feef46 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-deleted-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.206s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:58 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:12:58 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Deleted allocations for instance 68f7b119-b1c9-47ce-b325-5a4730aef707
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG nova.compute.manager [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] Acquiring lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] Lock "68f7b119-b1c9-47ce-b325-5a4730aef707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG nova.compute.manager [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] No waiting events found dispatching network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:12:59 user nova-compute[71330]: WARNING nova.compute.manager [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Received unexpected event network-vif-plugged-e5175890-c267-454b-b532-70223beb1f72 for instance with vm_state deleted and task_state None.
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:12:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:13:01 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:13:01 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7747MB free_disk=26.101341247558594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 545be51c-649c-4297-a924-bbb6ecf303dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance c659b3a7-fdf1-4513-8202-770d21f731b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing inventories for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating ProviderTree inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing aggregate associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, aggregates: None {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 12:13:01 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing trait associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-changed-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Refreshing instance network info cache due to event network-changed-884fdba5-501f-4614-9e53-3e4b96a90630. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] Acquiring lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] Acquired lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Refreshing network info cache for port 884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:13:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:03 user nova-compute[71330]: DEBUG nova.network.neutron [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updated VIF entry in instance network info cache for port 884fdba5-501f-4614-9e53-3e4b96a90630. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:13:03 user nova-compute[71330]: DEBUG nova.network.neutron [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updating instance_info_cache with network_info: [{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:13:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] Releasing lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:13:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:05 user nova-compute[71330]: INFO nova.compute.manager [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Attaching volume 7daf6afe-aa4a-41fd-a6fd-2594e88abfdb to /dev/vdb
Apr 14 12:13:05 user nova-compute[71330]: DEBUG os_brick.utils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2336d0-4e98-435d-9d41-943864856cbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0aa3c2-93b5-4a21-8a5d-59bc7d670975]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e28779d-4c7d-4b5b-bf2d-2dbf281bc2e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[66beda3e-09a4-470b-a8b6-9a54c2c254bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:13:05 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:13:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a39dcaa-2542-44a4-94ec-fb5b061ab28d]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG os_brick.utils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:13:05 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updating existing volume attachment record: e46c55d1-7377-4373-aca5-6debfb61318f {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:07 user nova-compute[71330]: INFO nova.compute.manager [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attaching volume 51fa6908-5d02-4957-afda-68b84f2323e1 to /dev/vdb
Apr 14 12:13:07 user nova-compute[71330]: DEBUG os_brick.utils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:13:07 user nova-compute[71330]: INFO nova.compute.manager [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Unrescuing
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquired lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[23252b2d-0e41-4417-921b-78664b943bb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c030db23-fd01-4c01-8639-8e809cc2aa7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6462521f-1079-4f56-b616-97fb6e01adcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[332bab9b-baef-4b05-90b0-e7ef19f24e49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:13:07 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:13:07 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a273a3a1-7099-4eaa-955d-fdf3b433b226]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG os_brick.utils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating existing volume attachment record: 06ae605c-ed5a-45ab-89d8-d962981a428d {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:13:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Updating instance_info_cache with network_info: [{"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Releasing lock "refresh_cache-b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'flavor' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-unplugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-unplugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:13:08 user nova-compute[71330]: WARNING nova.compute.manager [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-unplugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:13:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:08 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances with incomplete migration  {{(pid=71330) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 12:13:08 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Instance destroyed successfully.
Apr 14 12:13:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psnPXVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:13:10 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:13:10 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:13:10 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2950e57-ce16-47ed-b7e7-eac29763e68c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:13:10 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:13:10 user nova-compute[71330]: WARNING nova.compute.manager [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:13:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:13:10 user nova-compute[71330]: WARNING nova.compute.manager [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state rescued and task_state unrescuing.
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1fa21-6bc4-4593-bccb-f293ec8c0a77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb] added
Apr 14 12:13:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2857fea0-90d1-454d-9a0b-20a097a21140]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f31ed30-fac7-4c60-9220-b573fec2fa7d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psnPXVYq {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psnPXVYq" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[48348a0d-2fb6-47f3-a28e-cc0779198082]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psnPXVYq'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2645d14-4873-4471-944b-9b9e8c0b399b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cded035-b52e-4d83-b59a-10047a1381f7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[756e0fa4-cd24-4ed6-952b-58865ea86b2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260]
Apr 14 12:13:10 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260] successful.
Apr 14 12:13:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3940c07d-3d6e-46ff-8cb8-9cc0b7127450]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cf5682-197e-473a-8634-2370fe3dc26e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:13:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:10 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:13:10 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e9f365-ad61-443b-916e-3fa62a0616ea]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:13:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psnPXVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:13:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:13:11 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23339633866626333', 'path': '/dev/sdg'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:13:11 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339633866626333', 'path': '/dev/sdg'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:13:11 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:13:11 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:13:11 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:13:11 user nova-compute[71330]:   <source dev="/dev/sdg"/>
Apr 14 12:13:11 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:13:11 user nova-compute[71330]:   <serial>7daf6afe-aa4a-41fd-a6fd-2594e88abfdb</serial>
Apr 14 12:13:11 user nova-compute[71330]: </disk>
Apr 14 12:13:11 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mohFulWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:13:12 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:13:12 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:13:12 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d720b8a-922e-4757-8755-f0e819032b72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:13:12 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No VIF found with MAC fa:16:3e:30:c4:fa, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa645e12-e401-413a-8974-9e92faea736e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1] added
Apr 14 12:13:12 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[441a66b0-ce5a-4c93-8426-53bf9b0c0464]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e4da30-dd0a-4e59-a994-dbff8603a1f5]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mohFulWK {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mohFulWK" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[da420cea-ffd0-4eba-b29b-bc4ef02b6ca1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mohFulWK'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474392.3519292, b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:13:12 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] VM Resumed (Lifecycle Event)
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3f5f46-1640-4f6d-bf1a-891ce69c56ca]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c44ee84-9dde-4cbc-93f2-24f1b4282883]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:13:12 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:13:12 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:13:12 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474392.3555017, b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:13:12 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] VM Started (Lifecycle Event)
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.689s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b42cc0-240d-441e-bf2d-54f9fe003b11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1, portal: 172.16.0.220,3260]
Apr 14 12:13:12 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1, portal: 172.16.0.220,3260] successful.
Apr 14 12:13:12 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a88ea0b-164c-4292-be67-8198b774b91d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:13:12 user nova-compute[71330]: WARNING nova.compute.manager [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state active and task_state None.
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2c080e-7ee0-47ff-ae8d-f91fef6f4ffe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:13:12 user nova-compute[71330]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 (non-flash)
Apr 14 12:13:12 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd3093b-9133-4a5c-ba4d-286b35c5d0d4]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mohFulWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474377.8992007, 68f7b119-b1c9-47ce-b325-5a4730aef707 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:13:12 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] VM Stopped (Lifecycle Event)
Apr 14 12:13:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-14904e1c-fa93-4196-bf41-d01e3d9fc953 None None] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:13:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG nova.compute.manager [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG nova.compute.manager [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71330) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG nova.objects.instance [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23730353135613863', 'path': '/dev/sdh'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730353135613863', 'path': '/dev/sdh'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG nova.objects.instance [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:13:13 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:13:13 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 12:13:13 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:13:13 user nova-compute[71330]:   <serial>51fa6908-5d02-4957-afda-68b84f2323e1</serial>
Apr 14 12:13:13 user nova-compute[71330]: </disk>
Apr 14 12:13:13 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-unplugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:13 user nova-compute[71330]: DEBUG nova.compute.manager [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-unplugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:13:13 user nova-compute[71330]: WARNING nova.compute.manager [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-unplugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state active and task_state powering-off.
Apr 14 12:13:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:13:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:13:14 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No VIF found with MAC fa:16:3e:b2:30:0b, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:13:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.781s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:14 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance destroyed successfully.
Apr 14 12:13:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:13:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.997s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:15 user nova-compute[71330]: DEBUG nova.compute.manager [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:13:15 user nova-compute[71330]: WARNING nova.compute.manager [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state stopped and task_state None.
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:16 user nova-compute[71330]: INFO nova.compute.manager [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Detaching volume 51fa6908-5d02-4957-afda-68b84f2323e1
Apr 14 12:13:16 user nova-compute[71330]: INFO nova.virt.block_device [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attempting to driver detach volume 51fa6908-5d02-4957-afda-68b84f2323e1 from mountpoint /dev/vdb
Apr 14 12:13:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Attempting to detach device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:13:16 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:13:16 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 12:13:16 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:13:16 user nova-compute[71330]:   <serial>51fa6908-5d02-4957-afda-68b84f2323e1</serial>
Apr 14 12:13:16 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:13:16 user nova-compute[71330]: </disk>
Apr 14 12:13:16 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:13:16 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully detached device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the persistent domain config.
Apr 14 12:13:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:13:16 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:13:16 user nova-compute[71330]:   <source dev="/dev/sdh"/>
Apr 14 12:13:16 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:13:16 user nova-compute[71330]:   <serial>51fa6908-5d02-4957-afda-68b84f2323e1</serial>
Apr 14 12:13:16 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:13:16 user nova-compute[71330]: </disk>
Apr 14 12:13:16 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474396.7693567, a83e502a-7b98-4a46-ae3d-82339fbf07ca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:13:16 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully detached device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the live domain config.
Apr 14 12:13:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mohFulWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:13:16 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea20ed5-1fe7-4552-ad12-460187b8fe98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:13:16 user nova-compute[71330]: No targets found.
Apr 14 12:13:16 user nova-compute[71330]: iSNS:
Apr 14 12:13:16 user nova-compute[71330]: No targets found.
Apr 14 12:13:16 user nova-compute[71330]: STATIC:
Apr 14 12:13:16 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:13:16 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:13:16 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:13:16 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:13:16 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:13:16 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:13:16 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b
Apr 14 12:13:16 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:13:16 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:13:16 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:13:16 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:13:16 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:13:16 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95
Apr 14 12:13:16 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:13:16 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:13:16 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1
Apr 14 12:13:16 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:13:16 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:13:16 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07
Apr 14 12:13:16 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:13:16 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:13:16 user nova-compute[71330]: FIRMWARE:
Apr 14 12:13:16 user nova-compute[71330]: No targets found.
Apr 14 12:13:16 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:13:16 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:13:16 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62a3729-9920-4cfe-bef9-4c26c1598b02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[380e57d0-fd7e-4027-91f7-10a5639adf8c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:13:16 user nova-compute[71330]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 (non-flash)
Apr 14 12:13:16 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495f9b67a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1'): ({'sdh'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Removing single pathed devices sdh {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[898024ba-9a9e-464d-8349-1dd06a63e00d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9a5793-427f-487b-a088-41dcbde88e6a]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Flushing IO for device /dev/sdh {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f235f7ea-56e7-4780-87a0-2285378f95a6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[85042985-e95d-40ec-bc7d-1e7ebf42f741]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] SCSI volumes sdh have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:13:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e01ae60-81a1-425c-b5b0-dd0a8d7e0065]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8714d8b-0a15-48c4-8050-09dbaf83dc3e]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1, portal: 172.16.0.220,3260]
Apr 14 12:13:17 user nova-compute[71330]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1, portal: 172.16.0.220,3260] successful.
Apr 14 12:13:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51fa6908-5d02-4957-afda-68b84f2323e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c1389-d641-4335-8021-9ed0a3b220dc]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== disconnect_volume: return (333ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG nova.objects.instance [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:29 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474394.374991, 9741284c-15ce-41e3-934d-bf8f46a407f5 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:13:29 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] VM Stopped (Lifecycle Event)
Apr 14 12:13:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2cda9859-a79a-4e09-a86f-87a76a8ef5b0 None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:13:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2cda9859-a79a-4e09-a86f-87a76a8ef5b0 None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:13:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:45 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:13:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:13:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:13:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:13:46 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [{"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:13:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-11e4aa91-7c03-46cc-8610-78f18bbd089f" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:13:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:13:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:47 user nova-compute[71330]: INFO nova.compute.manager [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Terminating instance
Apr 14 12:13:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:13:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-unplugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-unplugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-unplugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:13:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Instance destroyed successfully.
Apr 14 12:13:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'resources' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621276567',display_name='tempest-ServerRescueNegativeTestJSON-server-1621276567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621276567',id=1,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f042abdcef8f41488e8f4624c2f4970b',ramdisk_id='',reservation_id='r-x60bo87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-896417797',owner_user_name='tempest-ServerRescueNegativeTestJSON-896417797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:03:36Z,user_data=None,user_id='263c47076ee94cfaaa34eff928a36fdd',uuid=16a25a1d-bc8b-4de0-b975-037aee0d46ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converting VIF {"id": "e6abe9bd-ec11-4204-9e3d-79e395495588", "address": "fa:16:3e:66:f5:bb", "network": {"id": "a732efb0-3274-408d-aabd-725f667bc8f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1463335132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f042abdcef8f41488e8f4624c2f4970b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6abe9bd-ec", "ovs_interfaceid": "e6abe9bd-ec11-4204-9e3d-79e395495588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:f5:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6abe9bd-ec11-4204-9e3d-79e395495588,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6abe9bd-ec') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG os_vif [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:f5:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6abe9bd-ec11-4204-9e3d-79e395495588,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6abe9bd-ec') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6abe9bd-ec, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:48 user nova-compute[71330]: INFO os_vif [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:f5:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6abe9bd-ec11-4204-9e3d-79e395495588,network=Network(a732efb0-3274-408d-aabd-725f667bc8f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6abe9bd-ec')
Apr 14 12:13:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Deleting instance files /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee_del
Apr 14 12:13:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Deletion of /opt/stack/data/nova/instances/16a25a1d-bc8b-4de0-b975-037aee0d46ee_del complete
Apr 14 12:13:48 user nova-compute[71330]: INFO nova.compute.manager [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 14 12:13:48 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:13:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:49 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:13:49 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Took 0.45 seconds to deallocate network for instance.
Apr 14 12:13:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:49 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:13:49 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:13:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:49 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Deleted allocations for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee
Apr 14 12:13:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.677s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] Acquiring lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] Lock "16a25a1d-bc8b-4de0-b975-037aee0d46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] No waiting events found dispatching network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:13:50 user nova-compute[71330]: WARNING nova.compute.manager [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received unexpected event network-vif-plugged-e6abe9bd-ec11-4204-9e3d-79e395495588 for instance with vm_state deleted and task_state None.
Apr 14 12:13:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Received event network-vif-deleted-e6abe9bd-ec11-4204-9e3d-79e395495588 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_power_states {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 3a308eef-321e-45c9-bc63-f99c4eacef85 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 545be51c-649c-4297-a924-bbb6ecf303dd {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid b350d4ef-74fe-4642-b1fd-4f15e10db590 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid c659b3a7-fdf1-4513-8202-770d21f731b2 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "3a308eef-321e-45c9-bc63-f99c4eacef85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "fcd74f51-099e-4c19-af7d-912f622fb153" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "545be51c-649c-4297-a924-bbb6ecf303dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "545be51c-649c-4297-a924-bbb6ecf303dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "b350d4ef-74fe-4642-b1fd-4f15e10db590" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "c659b3a7-fdf1-4513-8202-770d21f731b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "fcd74f51-099e-4c19-af7d-912f622fb153" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "545be51c-649c-4297-a924-bbb6ecf303dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:53 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:59 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:13:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:13:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:13:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:13:59 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:13:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:13:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:13:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:13:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:14:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:14:01 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:14:01 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=7971MB free_disk=26.111042022705078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 545be51c-649c-4297-a924-bbb6ecf303dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance c659b3a7-fdf1-4513-8202-770d21f731b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:14:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:14:02 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:14:02 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:14:02 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:14:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:14:03 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474428.5086918, 16a25a1d-bc8b-4de0-b975-037aee0d46ee => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:14:03 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] VM Stopped (Lifecycle Event)
Apr 14 12:14:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-4b4b95c2-f72b-4175-b729-4d62e952e7a6 None None] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:14:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "c659b3a7-fdf1-4513-8202-770d21f731b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:08 user nova-compute[71330]: INFO nova.compute.manager [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Terminating instance
Apr 14 12:14:08 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received event network-vif-unplugged-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] Acquiring lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] No waiting events found dispatching network-vif-unplugged-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received event network-vif-unplugged-74de70a0-4308-49c6-bef0-449f745b6085 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:08 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Instance destroyed successfully.
Apr 14 12:14:08 user nova-compute[71330]: DEBUG nova.objects.instance [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'resources' on Instance uuid c659b3a7-fdf1-4513-8202-770d21f731b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1534345749',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1534345749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1534345749',id=31,image_ref='30788121-99e9-48c7-9bac-0c68400ba1d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:12:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-oaz3hi1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2042813947',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:12:35Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=c659b3a7-fdf1-4513-8202-770d21f731b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "74de70a0-4308-49c6-bef0-449f745b6085", "address": "fa:16:3e:1c:4c:4e", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de70a0-43", "ovs_interfaceid": "74de70a0-4308-49c6-bef0-449f745b6085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:4c:4e,bridge_name='br-int',has_traffic_filtering=True,id=74de70a0-4308-49c6-bef0-449f745b6085,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de70a0-43') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG os_vif [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:4c:4e,bridge_name='br-int',has_traffic_filtering=True,id=74de70a0-4308-49c6-bef0-449f745b6085,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de70a0-43') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74de70a0-43, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:08 user nova-compute[71330]: INFO os_vif [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:4c:4e,bridge_name='br-int',has_traffic_filtering=True,id=74de70a0-4308-49c6-bef0-449f745b6085,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de70a0-43')
Apr 14 12:14:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efpomYOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:14:08 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:14:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef772ea-913f-4e41-bf2d-c50be329ce0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:14:08 user nova-compute[71330]: No targets found.
Apr 14 12:14:08 user nova-compute[71330]: iSNS:
Apr 14 12:14:08 user nova-compute[71330]: No targets found.
Apr 14 12:14:08 user nova-compute[71330]: STATIC:
Apr 14 12:14:08 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:14:08 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:08 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:08 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:14:08 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:08 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:08 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b
Apr 14 12:14:08 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:08 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:08 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:14:08 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:08 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:08 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95
Apr 14 12:14:08 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:08 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:08 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07
Apr 14 12:14:08 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:08 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:08 user nova-compute[71330]: FIRMWARE:
Apr 14 12:14:08 user nova-compute[71330]: No targets found.
Apr 14 12:14:08 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:14:08 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:14:08 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:14:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5921a60a-6769-465c-a3a4-21f311b03727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafc9f62-a643-47c0-83fb-c770d678b4ff]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 (non-flash)
Apr 14 12:14:09 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c22f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95'): ({'sdf'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Removing single pathed devices sdf {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[757ff8ce-2d87-4c46-8288-c5fbd9b563eb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0225a2e3-67cf-4219-a570-b7c15416054f]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flushing IO for device /dev/sdf {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f12d61-0b1f-4577-83aa-be9a12e45bf4]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e138da3c-6a43-4a10-9e3a-0c542de2a52e]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23363623239316538', '/dev/disk/by-id/scsi-1SCST_BIO89027078-3cb291e84d4113ec', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_89027078') {{(pid=82058) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 12:14:09 user nova-compute[71330]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23363623239316538
Apr 14 12:14:09 user nova-compute[71330]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO89027078-3cb291e84d4113ec
Apr 14 12:14:09 user nova-compute[71330]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_89027078
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c4c6f-e937-4ebc-83b1-4b7ae2cb74ea]: (4, None) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d03371f-b23a-42d7-8c21-d2410cf6b6d2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d588b2d3-2352-4dab-8672-22610f93ad34]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95, portal: 172.16.0.220,3260]
Apr 14 12:14:09 user nova-compute[71330]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95, portal: 172.16.0.220,3260] successful.
Apr 14 12:14:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1734b42f-80c5-4abc-9a00-cd6a1f7ead95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e242ba3-1c01-46d4-8c86-3cac9e832b53]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== disconnect_volume: return (354ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:14:09 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Deleting instance files /opt/stack/data/nova/instances/c659b3a7-fdf1-4513-8202-770d21f731b2_del
Apr 14 12:14:09 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Deletion of /opt/stack/data/nova/instances/c659b3a7-fdf1-4513-8202-770d21f731b2_del complete
Apr 14 12:14:09 user nova-compute[71330]: INFO nova.compute.manager [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Took 1.28 seconds to destroy the instance on the hypervisor.
Apr 14 12:14:09 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:14:09 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:14:09 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Took 0.46 seconds to deallocate network for instance.
Apr 14 12:14:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-8f17622c-77c4-492e-b6b3-8ec9d1080ccc req-d905505b-e1a7-49cb-aff4-2afa7289bd99 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received event network-vif-deleted-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:10 user nova-compute[71330]: INFO nova.compute.manager [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attaching volume 2b0841df-a3c9-4fb3-8685-44b2a2bb3923 to /dev/vdb
Apr 14 12:14:10 user nova-compute[71330]: DEBUG os_brick.utils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received event network-vif-plugged-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] Acquiring lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] No waiting events found dispatching network-vif-plugged-74de70a0-4308-49c6-bef0-449f745b6085 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:10 user nova-compute[71330]: WARNING nova.compute.manager [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Received unexpected event network-vif-plugged-74de70a0-4308-49c6-bef0-449f745b6085 for instance with vm_state active and task_state deleting.
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e54242b-c69c-4513-a60e-d5df597dc1d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[637c3099-ad57-4aba-9043-403e2aeed05c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcfabbc-72bd-4bc0-b0d0-bbe02bcd0a51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6800bed7-f92e-4a16-a10f-043d6526f9aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:14:10 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ecba55-2050-4431-87a1-6d4e23b2bb30]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG os_brick.utils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating existing volume attachment record: 8ac441b3-1c25-4210-9bcd-dc26190506bd {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:14:10 user nova-compute[71330]: INFO nova.compute.manager [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Took 0.83 seconds to detach 1 volumes for instance.
Apr 14 12:14:10 user nova-compute[71330]: DEBUG nova.compute.manager [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Deleting volume: 1734b42f-80c5-4abc-9a00-cd6a1f7ead95 {{(pid=71330) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:11 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:14:11 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:14:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:11 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Deleted allocations for instance c659b3a7-fdf1-4513-8202-770d21f731b2
Apr 14 12:14:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "c659b3a7-fdf1-4513-8202-770d21f731b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.133s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqWQRaFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:14:15 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:14:15 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:14:15 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ea8358-e39d-45f1-ab3e-8588f5e20978]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:14:15 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d46d5c-d36a-437d-a7b1-dd10edb02289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923] added
Apr 14 12:14:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c255ff8-344b-493c-beba-cfeab7583672]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b1d434-bd40-4eec-9753-e3e17b5ed4fc]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqWQRaFe {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqWQRaFe" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12f6dcc-c28d-4617-93d7-eb3d1121de42]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqWQRaFe'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaada841-ae81-4862-90a8-b61b7ca9ea7e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[765c6188-55c5-48bf-967f-f377c9993bbe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd613693-2964-409c-8780-a544920515a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923, portal: 172.16.0.220,3260]
Apr 14 12:14:15 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923, portal: 172.16.0.220,3260] successful.
Apr 14 12:14:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1393e150-2556-4130-bec6-e6219e8b06da]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a15ac9-4cee-4a27-a83b-e43701ba16f3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:15 user nova-compute[71330]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 (non-flash)
Apr 14 12:14:15 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a83932-dbe1-4166-b551-90a40c4956bc]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:15 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqWQRaFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23933343464373635', 'path': '/dev/sdf'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933343464373635', 'path': '/dev/sdf'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:14:16 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:14:16 user nova-compute[71330]:   <source dev="/dev/sdf"/>
Apr 14 12:14:16 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:14:16 user nova-compute[71330]:   <serial>2b0841df-a3c9-4fb3-8685-44b2a2bb3923</serial>
Apr 14 12:14:16 user nova-compute[71330]: </disk>
Apr 14 12:14:16 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No VIF found with MAC fa:16:3e:b2:30:0b, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:14:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.530s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:18 user nova-compute[71330]: INFO nova.compute.manager [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Detaching volume 2b0841df-a3c9-4fb3-8685-44b2a2bb3923
Apr 14 12:14:18 user nova-compute[71330]: INFO nova.virt.block_device [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attempting to driver detach volume 2b0841df-a3c9-4fb3-8685-44b2a2bb3923 from mountpoint /dev/vdb
Apr 14 12:14:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Attempting to detach device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:14:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:14:18 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:14:18 user nova-compute[71330]:   <source dev="/dev/sdf"/>
Apr 14 12:14:18 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:14:18 user nova-compute[71330]:   <serial>2b0841df-a3c9-4fb3-8685-44b2a2bb3923</serial>
Apr 14 12:14:18 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:14:18 user nova-compute[71330]: </disk>
Apr 14 12:14:18 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:14:18 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully detached device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the persistent domain config.
Apr 14 12:14:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:14:18 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:14:18 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:14:18 user nova-compute[71330]:   <source dev="/dev/sdf"/>
Apr 14 12:14:18 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:14:18 user nova-compute[71330]:   <serial>2b0841df-a3c9-4fb3-8685-44b2a2bb3923</serial>
Apr 14 12:14:18 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:14:18 user nova-compute[71330]: </disk>
Apr 14 12:14:18 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:14:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474459.1463797, a83e502a-7b98-4a46-ae3d-82339fbf07ca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:14:19 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully detached device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the live domain config.
Apr 14 12:14:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqWQRaFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:14:19 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee446daa-5dca-4934-9367-a7e655e6d54f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:14:19 user nova-compute[71330]: No targets found.
Apr 14 12:14:19 user nova-compute[71330]: iSNS:
Apr 14 12:14:19 user nova-compute[71330]: No targets found.
Apr 14 12:14:19 user nova-compute[71330]: STATIC:
Apr 14 12:14:19 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:14:19 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:19 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:19 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:14:19 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:19 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:19 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b
Apr 14 12:14:19 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:19 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:19 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923
Apr 14 12:14:19 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:19 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:19 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:14:19 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:19 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:19 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07
Apr 14 12:14:19 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:19 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:19 user nova-compute[71330]: FIRMWARE:
Apr 14 12:14:19 user nova-compute[71330]: No targets found.
Apr 14 12:14:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:14:19 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:14:19 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2239523-a88f-4930-b0ae-8aab3f14d423]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec423fb-6763-4a76-be53-2f76b78487a2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 (non-flash)
Apr 14 12:14:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:19 user nova-compute[71330]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 (non-flash)
Apr 14 12:14:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962be5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923'): ({'sdf'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Removing single pathed devices sdf {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8895527-f569-4c1c-a30f-636913eecd22]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4489870-dc24-43b6-930f-bb809a6eaccb]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Flushing IO for device /dev/sdf {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b061aa-d55e-4681-94f4-fe3d75432818]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb1c28c-bf42-48ec-bf81-6967d9843335]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] SCSI volumes sdf have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5d1eb0-25ae-4401-bbd1-48c52104249b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[837aab47-d5b6-4e1c-acb9-bc7c8c86bafd]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923, portal: 172.16.0.220,3260]
Apr 14 12:14:19 user nova-compute[71330]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923, portal: 172.16.0.220,3260] successful.
Apr 14 12:14:19 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b0841df-a3c9-4fb3-8685-44b2a2bb3923 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d216226e-3034-4a57-a99e-5add9c35f58c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== disconnect_volume: return (320ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:14:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:20 user nova-compute[71330]: DEBUG nova.objects.instance [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:14:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:23 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474448.9103572, c659b3a7-fdf1-4513-8202-770d21f731b2 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:14:23 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] VM Stopped (Lifecycle Event)
Apr 14 12:14:23 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7f347f31-ceeb-4fea-8ef2-bed53bc9ce98 None None] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:14:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:14:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:14:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:14:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:14:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:14:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:14:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-545be51c-649c-4297-a924-bbb6ecf303dd" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:14:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-545be51c-649c-4297-a924-bbb6ecf303dd" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:14:46 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:14:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Updating instance_info_cache with network_info: [{"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:14:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-545be51c-649c-4297-a924-bbb6ecf303dd" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:14:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:14:48 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:14:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "e745394e-1cf2-40d8-a7ec-003677309895" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "e745394e-1cf2-40d8-a7ec-003677309895" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:14:50 user nova-compute[71330]: INFO nova.compute.claims [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Claim successful on node user
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:14:50 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.policy [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:14:50 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Creating image(s)
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "/opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "/opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "/opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk 1073741824" returned: 0 in 0.052s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Successfully created port: 4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Cannot resize image /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lazy-loading 'migration_context' on Instance uuid e745394e-1cf2-40d8-a7ec-003677309895 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Ensure instance console log exists: /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Successfully updated port: 4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquired lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received event network-changed-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Refreshing instance network info cache due to event network-changed-4b8b30df-bc81-40b6-830e-c9846bb3b98e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] Acquiring lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Updating instance_info_cache with network_info: [{"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Releasing lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Instance network_info: |[{"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] Acquired lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.neutron [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Refreshing network info cache for port 4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Start _get_guest_xml network_info=[{"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:14:52 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:14:52 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-988610230',display_name='tempest-ServersNegativeTestJSON-server-988610230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-988610230',id=32,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930c6e3aceb3445c8bed09847c92f271',ramdisk_id='',reservation_id='r-5kbh2w4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1103109288',owner_user_name='tempest-ServersNegativeTestJSON-1103109288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:14:51Z,user_data=None,user_id='f4063336b73e44ed991ca650d60bb3cd',uuid=e745394e-1cf2-40d8-a7ec-003677309895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converting VIF {"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:d8:91,bridge_name='br-int',has_traffic_filtering=True,id=4b8b30df-bc81-40b6-830e-c9846bb3b98e,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b8b30df-bc') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.objects.instance [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lazy-loading 'pci_devices' on Instance uuid e745394e-1cf2-40d8-a7ec-003677309895 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:14:52 user nova-compute[71330]:   <uuid>e745394e-1cf2-40d8-a7ec-003677309895</uuid>
Apr 14 12:14:52 user nova-compute[71330]:   <name>instance-00000020</name>
Apr 14 12:14:52 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:14:52 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:14:52 user nova-compute[71330]:   <metadata>
Apr 14 12:14:52 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:14:52 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:14:52 user nova-compute[71330]:       <nova:name>tempest-ServersNegativeTestJSON-server-988610230</nova:name>
Apr 14 12:14:52 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:14:52</nova:creationTime>
Apr 14 12:14:52 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:14:52 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:14:52 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:14:52 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:14:52 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:14:52 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:14:52 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:14:52 user nova-compute[71330]:       <nova:owner>
Apr 14 12:14:52 user nova-compute[71330]:         <nova:user uuid="f4063336b73e44ed991ca650d60bb3cd">tempest-ServersNegativeTestJSON-1103109288-project-member</nova:user>
Apr 14 12:14:52 user nova-compute[71330]:         <nova:project uuid="930c6e3aceb3445c8bed09847c92f271">tempest-ServersNegativeTestJSON-1103109288</nova:project>
Apr 14 12:14:52 user nova-compute[71330]:       </nova:owner>
Apr 14 12:14:52 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:14:52 user nova-compute[71330]:       <nova:ports>
Apr 14 12:14:52 user nova-compute[71330]:         <nova:port uuid="4b8b30df-bc81-40b6-830e-c9846bb3b98e">
Apr 14 12:14:52 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 12:14:52 user nova-compute[71330]:         </nova:port>
Apr 14 12:14:52 user nova-compute[71330]:       </nova:ports>
Apr 14 12:14:52 user nova-compute[71330]:     </nova:instance>
Apr 14 12:14:52 user nova-compute[71330]:   </metadata>
Apr 14 12:14:52 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:14:52 user nova-compute[71330]:     <system>
Apr 14 12:14:52 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:14:52 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:14:52 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:14:52 user nova-compute[71330]:       <entry name="serial">e745394e-1cf2-40d8-a7ec-003677309895</entry>
Apr 14 12:14:52 user nova-compute[71330]:       <entry name="uuid">e745394e-1cf2-40d8-a7ec-003677309895</entry>
Apr 14 12:14:52 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:14:52 user nova-compute[71330]:     </system>
Apr 14 12:14:52 user nova-compute[71330]:   </sysinfo>
Apr 14 12:14:52 user nova-compute[71330]:   <os>
Apr 14 12:14:52 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:14:52 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:14:52 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:14:52 user nova-compute[71330]:   </os>
Apr 14 12:14:52 user nova-compute[71330]:   <features>
Apr 14 12:14:52 user nova-compute[71330]:     <acpi/>
Apr 14 12:14:52 user nova-compute[71330]:     <apic/>
Apr 14 12:14:52 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:14:52 user nova-compute[71330]:   </features>
Apr 14 12:14:52 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:14:52 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:14:52 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:14:52 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:14:52 user nova-compute[71330]:   </clock>
Apr 14 12:14:52 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:14:52 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:14:52 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:14:52 user nova-compute[71330]:   </cpu>
Apr 14 12:14:52 user nova-compute[71330]:   <devices>
Apr 14 12:14:52 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:14:52 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:14:52 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk"/>
Apr 14 12:14:52 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:14:52 user nova-compute[71330]:     </disk>
Apr 14 12:14:52 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:14:52 user nova-compute[71330]:       <mac address="fa:16:3e:93:d8:91"/>
Apr 14 12:14:52 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:14:52 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:14:52 user nova-compute[71330]:       <target dev="tap4b8b30df-bc"/>
Apr 14 12:14:52 user nova-compute[71330]:     </interface>
Apr 14 12:14:52 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:14:52 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/console.log" append="off"/>
Apr 14 12:14:52 user nova-compute[71330]:     </serial>
Apr 14 12:14:52 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:14:52 user nova-compute[71330]:     <video>
Apr 14 12:14:52 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:14:52 user nova-compute[71330]:     </video>
Apr 14 12:14:52 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:14:52 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:14:52 user nova-compute[71330]:     </rng>
Apr 14 12:14:52 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:14:52 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:14:52 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:14:52 user nova-compute[71330]:     </memballoon>
Apr 14 12:14:52 user nova-compute[71330]:   </devices>
Apr 14 12:14:52 user nova-compute[71330]: </domain>
Apr 14 12:14:52 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-988610230',display_name='tempest-ServersNegativeTestJSON-server-988610230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-988610230',id=32,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930c6e3aceb3445c8bed09847c92f271',ramdisk_id='',reservation_id='r-5kbh2w4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1103109288',owner_user_name='tempest-ServersNegativeTestJSON-1103109288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:14:51Z,user_data=None,user_id='f4063336b73e44ed991ca650d60bb3cd',uuid=e745394e-1cf2-40d8-a7ec-003677309895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converting VIF {"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:d8:91,bridge_name='br-int',has_traffic_filtering=True,id=4b8b30df-bc81-40b6-830e-c9846bb3b98e,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b8b30df-bc') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG os_vif [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d8:91,bridge_name='br-int',has_traffic_filtering=True,id=4b8b30df-bc81-40b6-830e-c9846bb3b98e,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b8b30df-bc') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b8b30df-bc, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b8b30df-bc, col_values=(('external_ids', {'iface-id': '4b8b30df-bc81-40b6-830e-c9846bb3b98e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:d8:91', 'vm-uuid': 'e745394e-1cf2-40d8-a7ec-003677309895'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:52 user nova-compute[71330]: INFO os_vif [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d8:91,bridge_name='br-int',has_traffic_filtering=True,id=4b8b30df-bc81-40b6-830e-c9846bb3b98e,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b8b30df-bc')
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] No VIF found with MAC fa:16:3e:93:d8:91, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.neutron [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Updated VIF entry in instance network info cache for port 4b8b30df-bc81-40b6-830e-c9846bb3b98e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG nova.network.neutron [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Updating instance_info_cache with network_info: [{"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:14:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] Releasing lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:53 user nova-compute[71330]: INFO nova.compute.manager [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Terminating instance
Apr 14 12:14:53 user nova-compute[71330]: DEBUG nova.compute.manager [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Instance destroyed successfully.
Apr 14 12:14:54 user nova-compute[71330]: DEBUG nova.objects.instance [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'resources' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-523755696',display_name='tempest-ServerActionsTestJSON-server-451636587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-523755696',id=15,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:12:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-tirm3a0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:12:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=11e4aa91-7c03-46cc-8610-78f18bbd089f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "address": "fa:16:3e:e5:db:94", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cd0790-d7", "ovs_interfaceid": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_vif [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7cd0790-d7, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: INFO os_vif [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:94,bridge_name='br-int',has_traffic_filtering=True,id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cd0790-d7')
Apr 14 12:14:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYGzSdrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:14:54 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[20249e22-c055-42dc-a5c3-900e135a0d24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:14:54 user nova-compute[71330]: No targets found.
Apr 14 12:14:54 user nova-compute[71330]: iSNS:
Apr 14 12:14:54 user nova-compute[71330]: No targets found.
Apr 14 12:14:54 user nova-compute[71330]: STATIC:
Apr 14 12:14:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:14:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:14:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b
Apr 14 12:14:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:14:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:54 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07
Apr 14 12:14:54 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:54 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:54 user nova-compute[71330]: FIRMWARE:
Apr 14 12:14:54 user nova-compute[71330]: No targets found.
Apr 14 12:14:54 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:14:54 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:14:54 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc536b27-2cae-49dd-8df7-f56287dc561b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3602d2c4-f3a4-4c13-8069-8570ae77c5d8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:54 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:54 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:54 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:54 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:54 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:54 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:54 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:54 user nova-compute[71330]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b (non-flash)
Apr 14 12:14:54 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:54 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c2c37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeb813b-56b4-4d07-900e-ada8897af5fe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c0ee52-e9cd-4b4c-bd3f-a617c8e99a41]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4701f91d-7d67-46b6-8f1e-32d46ad27f34]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bef0f3-e71b-4a06-8a59-52cddf27a357]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2fed9b-26bb-4ebc-87b3-10055d138e80]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7115390-9dff-4294-a15e-f9088cb46792]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260]
Apr 14 12:14:54 user nova-compute[71330]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b, portal: 172.16.0.220,3260] successful.
Apr 14 12:14:54 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42f9d56-b181-465a-9ed8-ef4b1f47832b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8210946-ea04-49ac-859c-4c0e1d980e2e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== disconnect_volume: return (320ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:14:54 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Deleting instance files /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f_del
Apr 14 12:14:54 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Deletion of /opt/stack/data/nova/instances/11e4aa91-7c03-46cc-8610-78f18bbd089f_del complete
Apr 14 12:14:54 user nova-compute[71330]: INFO nova.compute.manager [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Took 1.57 seconds to destroy the instance on the hypervisor.
Apr 14 12:14:54 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:14:54 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:55 user nova-compute[71330]: WARNING nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state deleting.
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received event network-vif-plugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Acquiring lock "e745394e-1cf2-40d8-a7ec-003677309895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] No waiting events found dispatching network-vif-plugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:55 user nova-compute[71330]: WARNING nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received unexpected event network-vif-plugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance with vm_state building and task_state spawning.
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received event network-vif-plugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Acquiring lock "e745394e-1cf2-40d8-a7ec-003677309895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] No waiting events found dispatching network-vif-plugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:55 user nova-compute[71330]: WARNING nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received unexpected event network-vif-plugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance with vm_state building and task_state spawning.
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:55 user nova-compute[71330]: WARNING nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state deleting.
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:55 user nova-compute[71330]: WARNING nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state deleting.
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-unplugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Acquiring lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] No waiting events found dispatching network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:55 user nova-compute[71330]: WARNING nova.compute.manager [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received unexpected event network-vif-plugged-d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance with vm_state active and task_state deleting.
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Received event network-vif-deleted-d7cd0790-d778-4855-b7ad-c0b5c0258c1b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:55 user nova-compute[71330]: INFO nova.compute.manager [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Neutron deleted interface d7cd0790-d778-4855-b7ad-c0b5c0258c1b; detaching it from the instance and deleting it from the info cache
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.network.neutron [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:14:55 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Took 0.84 seconds to deallocate network for instance.
Apr 14 12:14:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Detach interface failed, port_id=d7cd0790-d778-4855-b7ad-c0b5c0258c1b, reason: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474496.3505602, e745394e-1cf2-40d8-a7ec-003677309895 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:14:56 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] VM Resumed (Lifecycle Event)
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:14:56 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Instance spawned successfully.
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:14:56 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474496.353224, e745394e-1cf2-40d8-a7ec-003677309895 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:14:56 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] VM Started (Lifecycle Event)
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:14:56 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:14:56 user nova-compute[71330]: INFO nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Took 5.64 seconds to spawn the instance on the hypervisor.
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:14:56 user nova-compute[71330]: INFO nova.compute.manager [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Took 6.28 seconds to build instance.
Apr 14 12:14:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "e745394e-1cf2-40d8-a7ec-003677309895" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.368s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:56 user nova-compute[71330]: INFO nova.compute.manager [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 12:14:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:14:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:56 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Deleted allocations for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f
Apr 14 12:14:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "11e4aa91-7c03-46cc-8610-78f18bbd089f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.654s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:58 user nova-compute[71330]: INFO nova.compute.manager [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Terminating instance
Apr 14 12:14:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-unplugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-unplugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG nova.compute.manager [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-unplugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:59 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Instance destroyed successfully.
Apr 14 12:14:59 user nova-compute[71330]: DEBUG nova.objects.instance [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'resources' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1172257873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1172257873',id=27,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:11:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-hbo3f45m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:13:12Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=b5b4cd5e-d786-4c51-978b-7ff76e21d1b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "address": "fa:16:3e:ff:54:50", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6facec09-5f", "ovs_interfaceid": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:54:50,bridge_name='br-int',has_traffic_filtering=True,id=6facec09-5fc6-423c-9c30-9a1ca2ea0d05,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6facec09-5f') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_vif [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:54:50,bridge_name='br-int',has_traffic_filtering=True,id=6facec09-5fc6-423c-9c30-9a1ca2ea0d05,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6facec09-5f') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6facec09-5f, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:14:59 user nova-compute[71330]: INFO os_vif [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:54:50,bridge_name='br-int',has_traffic_filtering=True,id=6facec09-5fc6-423c-9c30-9a1ca2ea0d05,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6facec09-5f')
Apr 14 12:14:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKxFToAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:14:59 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dedac13-27b9-4459-8521-bc8633fef68a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:14:59 user nova-compute[71330]: No targets found.
Apr 14 12:14:59 user nova-compute[71330]: iSNS:
Apr 14 12:14:59 user nova-compute[71330]: No targets found.
Apr 14 12:14:59 user nova-compute[71330]: STATIC:
Apr 14 12:14:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050
Apr 14 12:14:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:14:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:14:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:59 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07
Apr 14 12:14:59 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:14:59 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:14:59 user nova-compute[71330]: FIRMWARE:
Apr 14 12:14:59 user nova-compute[71330]: No targets found.
Apr 14 12:14:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:14:59 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:14:59 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a512ed02-3dc1-45c3-8760-d1ceab22bff9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[616ba58d-bccd-4cde-bf35-9c9f68ded491]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:59 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:59 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:59 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:14:59 user nova-compute[71330]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 (non-flash)
Apr 14 12:14:59 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:14:59 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:14:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c2c29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a10b11-2a3e-4c47-9074-3dad5946e089]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda94b4c-f829-43ce-8562-e7ea722d1263]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac23d640-b67c-4b45-95be-a6104a1d37e0]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b51cc98-5bed-4aee-a2c3-f42c229c5ca6]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e01f3-28ee-4692-b85a-37f00951a2a9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[25914112-93f2-468e-a082-5fce3afccd69]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050, portal: 172.16.0.220,3260]
Apr 14 12:14:59 user nova-compute[71330]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050, portal: 172.16.0.220,3260] successful.
Apr 14 12:14:59 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619cf8ad-1c8f-46f7-9838-4ea7cbceb050 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[831782e7-d151-47a6-871d-61a0604d505c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] <== disconnect_volume: return (330ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:14:59 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Deleting instance files /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2_del
Apr 14 12:14:59 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Deletion of /opt/stack/data/nova/instances/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2_del complete
Apr 14 12:14:59 user nova-compute[71330]: INFO nova.compute.manager [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 14 12:14:59 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:14:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:15:00 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Took 0.57 seconds to deallocate network for instance.
Apr 14 12:15:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] Acquiring lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] No waiting events found dispatching network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:15:00 user nova-compute[71330]: WARNING nova.compute.manager [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received unexpected event network-vif-plugged-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance with vm_state active and task_state deleting.
Apr 14 12:15:00 user nova-compute[71330]: DEBUG nova.compute.manager [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Received event network-vif-deleted-6facec09-5fc6-423c-9c30-9a1ca2ea0d05 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:15:00 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:01 user nova-compute[71330]: INFO nova.compute.manager [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Took 0.91 seconds to detach 1 volumes for instance.
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:01 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Deleted allocations for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.377s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "b350d4ef-74fe-4642-b1fd-4f15e10db590" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:01 user nova-compute[71330]: INFO nova.compute.manager [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Terminating instance
Apr 14 12:15:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received event network-vif-unplugged-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] Acquiring lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] No waiting events found dispatching network-vif-unplugged-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received event network-vif-unplugged-39f99cae-b8a9-4ebd-840c-f124cba0415e for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:15:02 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Instance destroyed successfully.
Apr 14 12:15:02 user nova-compute[71330]: DEBUG nova.objects.instance [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'resources' on Instance uuid b350d4ef-74fe-4642-b1fd-4f15e10db590 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2088634438',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2088634438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2088634438',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-s7dz8rx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:10:37Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=b350d4ef-74fe-4642-b1fd-4f15e10db590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "address": "fa:16:3e:71:ab:7a", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f99cae-b8", "ovs_interfaceid": "39f99cae-b8a9-4ebd-840c-f124cba0415e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=39f99cae-b8a9-4ebd-840c-f124cba0415e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f99cae-b8') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG os_vif [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=39f99cae-b8a9-4ebd-840c-f124cba0415e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f99cae-b8') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39f99cae-b8, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:15:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:02 user nova-compute[71330]: INFO os_vif [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=39f99cae-b8a9-4ebd-840c-f124cba0415e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f99cae-b8')
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltuNpFCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:15:03 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:15:03 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8248MB free_disk=26.127376556396484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ef2e87-c677-4b31-95e4-83317cac840c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:15:03 user nova-compute[71330]: No targets found.
Apr 14 12:15:03 user nova-compute[71330]: iSNS:
Apr 14 12:15:03 user nova-compute[71330]: No targets found.
Apr 14 12:15:03 user nova-compute[71330]: STATIC:
Apr 14 12:15:03 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:15:03 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:15:03 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:15:03 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:15:03 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:15:03 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:15:03 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07
Apr 14 12:15:03 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:15:03 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:15:03 user nova-compute[71330]: FIRMWARE:
Apr 14 12:15:03 user nova-compute[71330]: No targets found.
Apr 14 12:15:03 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:15:03 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:15:03 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0c98d6-9caa-4390-b350-15faed8268c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c34b5-832a-4231-9a16-d3958a42c1ed]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:03 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:15:03 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:03 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:03 user nova-compute[71330]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 (non-flash)
Apr 14 12:15:03 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:03 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495f9b6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07'): ({'sdd'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Removing single pathed devices sdd {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce80d3e-dd8c-48e2-8cbf-de221fd51f08]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe38b9c-b30c-4337-bbf4-2b7260859ffb]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flushing IO for device /dev/sdd {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 545be51c-649c-4297-a924-bbb6ecf303dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e745394e-1cf2-40d8-a7ec-003677309895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742e6f9-64ff-4510-9870-a90c5c1b0bdf]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f765bc-3151-4202-844a-773c28f3a5fd]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c388a-ae96-4407-a618-e6487c88f2dc]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb905bd-461f-4fb9-b0c0-1c833949f423]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07, portal: 172.16.0.220,3260]
Apr 14 12:15:03 user nova-compute[71330]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07, portal: 172.16.0.220,3260] successful.
Apr 14 12:15:03 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c08cb094-2346-4a3a-9cd4-758810dd7f07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[815eb410-a2c8-4522-bdcb-cc164c27f8a7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== disconnect_volume: return (330ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:15:03 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Deleting instance files /opt/stack/data/nova/instances/b350d4ef-74fe-4642-b1fd-4f15e10db590_del
Apr 14 12:15:03 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Deletion of /opt/stack/data/nova/instances/b350d4ef-74fe-4642-b1fd-4f15e10db590_del complete
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:03 user nova-compute[71330]: INFO nova.compute.manager [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Took 1.64 seconds to destroy the instance on the hypervisor.
Apr 14 12:15:03 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:15:03 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:15:04 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Took 0.45 seconds to deallocate network for instance.
Apr 14 12:15:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-2c3feef3-4ee1-477d-b87c-0114e0ae2c0e req-83cf2924-0ba2-41a4-aa3c-06c04b1e0055 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received event network-vif-deleted-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG nova.objects.instance [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquired lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG nova.objects.instance [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'info_cache' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received event network-vif-plugged-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] Acquiring lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] No waiting events found dispatching network-vif-plugged-39f99cae-b8a9-4ebd-840c-f124cba0415e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:15:04 user nova-compute[71330]: WARNING nova.compute.manager [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Received unexpected event network-vif-plugged-39f99cae-b8a9-4ebd-840c-f124cba0415e for instance with vm_state active and task_state deleting.
Apr 14 12:15:04 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:04 user nova-compute[71330]: INFO nova.compute.manager [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 12:15:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Deleting volume: c08cb094-2346-4a3a-9cd4-758810dd7f07 {{(pid=71330) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:05 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Deleted allocations for instance b350d4ef-74fe-4642-b1fd-4f15e10db590
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "b350d4ef-74fe-4642-b1fd-4f15e10db590" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.464s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updating instance_info_cache with network_info: [{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Releasing lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:15:05 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance destroyed successfully.
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.objects.instance [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'resources' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1732004801',display_name='tempest-AttachVolumeTestJSON-server-1732004801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1732004801',id=30,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA==',key_name='tempest-keypair-529761837',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-phdutbkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=9741284c-15ce-41e3-934d-bf8f46a407f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_vif [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap884fdba5-50, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:15:05 user nova-compute[71330]: INFO os_vif [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50')
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psnPXVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:15:05 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3ca31d-7478-43f2-9636-b92297cec9ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:15:05 user nova-compute[71330]: No targets found.
Apr 14 12:15:05 user nova-compute[71330]: iSNS:
Apr 14 12:15:05 user nova-compute[71330]: No targets found.
Apr 14 12:15:05 user nova-compute[71330]: STATIC:
Apr 14 12:15:05 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:15:05 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:15:05 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:15:05 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:15:05 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:15:05 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:15:05 user nova-compute[71330]: FIRMWARE:
Apr 14 12:15:05 user nova-compute[71330]: No targets found.
Apr 14 12:15:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:15:05 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:15:05 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7355a467-aabc-4d9b-a75b-b84d9b134f45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[36597cac-2094-4405-8762-2383867bbf69]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:05 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:05 user nova-compute[71330]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4918557520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb'): ({'sdg'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Removing single pathed devices sdg {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74f5c28-6c1b-4d1f-b64b-69c228eb9d13]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3cd245-377e-4b6d-b6a1-f42635819839]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flushing IO for device /dev/sdg {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bcfc9c-18c0-4bc0-b673-07c3dcdcca95]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea37ddd4-7855-42b3-825f-103cac36f1ee]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] SCSI volumes sdg have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2fdfa-4278-4a86-bae7-6da7d5b95734]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b555e3d8-452e-455f-a997-aa6b51899663]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260]
Apr 14 12:15:05 user nova-compute[71330]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260] successful.
Apr 14 12:15:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5725479b-bbfd-4dc4-91ef-1a5926f26ea3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== disconnect_volume: return (351ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Start _get_guest_xml network_info=[{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'e46c55d1-7377-4373-aca5-6debfb61318f', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psnPXVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '9741284c-15ce-41e3-934d-bf8f46a407f5', 'attached_at': '', 'detached_at': '', 'volume_id': '7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 'serial': '7daf6afe-aa4a-41fd-a6fd-2594e88abfdb'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:15:05 user nova-compute[71330]: DEBUG nova.objects.instance [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'numa_topology' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:06 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:15:06 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.objects.instance [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psnPXVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:15:06 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:15:06 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:15:06 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[73880392-44d4-462b-a85f-4694ef035694]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:15:06 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3339f64-5d03-47a9-bade-31f391f67a00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb] added
Apr 14 12:15:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2886b809-33a1-493d-aea4-d0c8c4f144d2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3435be3-ea3f-481f-a5c8-3df2ac574025]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psnPXVYq {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psnPXVYq" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[42829d8a-7f0f-48bb-8f79-a39c1a609e67]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psnPXVYq'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[416a961d-437e-4ce2-9f8b-26d758e064af]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b994de8e-e313-42ae-884d-b82321c06237]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b0886-6045-47ff-88f1-99471f07d86f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260]
Apr 14 12:15:06 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260] successful.
Apr 14 12:15:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd54fa65-ef5f-47e5-96b1-25d29d165ac8]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76a80b-299e-48fc-bb99-3d6dbc395fbd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:06 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:06 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:06 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c474883e-54a1-4232-9dca-810f36cd569b]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:15:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psnPXVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23339633866626333', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339633866626333', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1732004801',display_name='tempest-AttachVolumeTestJSON-server-1732004801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1732004801',id=30,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA==',key_name='tempest-keypair-529761837',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-phdutbkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=9741284c-15ce-41e3-934d-bf8f46a407f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'pci_devices' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:15:07 user nova-compute[71330]:   <uuid>9741284c-15ce-41e3-934d-bf8f46a407f5</uuid>
Apr 14 12:15:07 user nova-compute[71330]:   <name>instance-0000001e</name>
Apr 14 12:15:07 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:15:07 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:15:07 user nova-compute[71330]:   <metadata>
Apr 14 12:15:07 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:15:07 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:15:07 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeTestJSON-server-1732004801</nova:name>
Apr 14 12:15:07 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:15:06</nova:creationTime>
Apr 14 12:15:07 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:15:07 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:15:07 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:15:07 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:15:07 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:15:07 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:15:07 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:15:07 user nova-compute[71330]:       <nova:owner>
Apr 14 12:15:07 user nova-compute[71330]:         <nova:user uuid="b7a65855384e4146a344cceb744e3e40">tempest-AttachVolumeTestJSON-341361172-project-member</nova:user>
Apr 14 12:15:07 user nova-compute[71330]:         <nova:project uuid="90ff3910da7c47e9828549306fda25d7">tempest-AttachVolumeTestJSON-341361172</nova:project>
Apr 14 12:15:07 user nova-compute[71330]:       </nova:owner>
Apr 14 12:15:07 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:15:07 user nova-compute[71330]:       <nova:ports>
Apr 14 12:15:07 user nova-compute[71330]:         <nova:port uuid="884fdba5-501f-4614-9e53-3e4b96a90630">
Apr 14 12:15:07 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 12:15:07 user nova-compute[71330]:         </nova:port>
Apr 14 12:15:07 user nova-compute[71330]:       </nova:ports>
Apr 14 12:15:07 user nova-compute[71330]:     </nova:instance>
Apr 14 12:15:07 user nova-compute[71330]:   </metadata>
Apr 14 12:15:07 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:15:07 user nova-compute[71330]:     <system>
Apr 14 12:15:07 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:15:07 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:15:07 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:15:07 user nova-compute[71330]:       <entry name="serial">9741284c-15ce-41e3-934d-bf8f46a407f5</entry>
Apr 14 12:15:07 user nova-compute[71330]:       <entry name="uuid">9741284c-15ce-41e3-934d-bf8f46a407f5</entry>
Apr 14 12:15:07 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:15:07 user nova-compute[71330]:     </system>
Apr 14 12:15:07 user nova-compute[71330]:   </sysinfo>
Apr 14 12:15:07 user nova-compute[71330]:   <os>
Apr 14 12:15:07 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:15:07 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:15:07 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:15:07 user nova-compute[71330]:   </os>
Apr 14 12:15:07 user nova-compute[71330]:   <features>
Apr 14 12:15:07 user nova-compute[71330]:     <acpi/>
Apr 14 12:15:07 user nova-compute[71330]:     <apic/>
Apr 14 12:15:07 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:15:07 user nova-compute[71330]:   </features>
Apr 14 12:15:07 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:15:07 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:15:07 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:15:07 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:15:07 user nova-compute[71330]:   </clock>
Apr 14 12:15:07 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:15:07 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:15:07 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:15:07 user nova-compute[71330]:   </cpu>
Apr 14 12:15:07 user nova-compute[71330]:   <devices>
Apr 14 12:15:07 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:15:07 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:15:07 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk"/>
Apr 14 12:15:07 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:15:07 user nova-compute[71330]:     </disk>
Apr 14 12:15:07 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:15:07 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:15:07 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 12:15:07 user nova-compute[71330]:       <target dev="vdb" bus="virtio"/>
Apr 14 12:15:07 user nova-compute[71330]:       <serial>7daf6afe-aa4a-41fd-a6fd-2594e88abfdb</serial>
Apr 14 12:15:07 user nova-compute[71330]:     </disk>
Apr 14 12:15:07 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:15:07 user nova-compute[71330]:       <mac address="fa:16:3e:30:c4:fa"/>
Apr 14 12:15:07 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:15:07 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:15:07 user nova-compute[71330]:       <target dev="tap884fdba5-50"/>
Apr 14 12:15:07 user nova-compute[71330]:     </interface>
Apr 14 12:15:07 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:15:07 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/console.log" append="off"/>
Apr 14 12:15:07 user nova-compute[71330]:     </serial>
Apr 14 12:15:07 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:15:07 user nova-compute[71330]:     <video>
Apr 14 12:15:07 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:15:07 user nova-compute[71330]:     </video>
Apr 14 12:15:07 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:15:07 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:15:07 user nova-compute[71330]:     </rng>
Apr 14 12:15:07 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:15:07 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:15:07 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:15:07 user nova-compute[71330]:     </memballoon>
Apr 14 12:15:07 user nova-compute[71330]:   </devices>
Apr 14 12:15:07 user nova-compute[71330]: </domain>
Apr 14 12:15:07 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG nova.objects.instance [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.455s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Cannot resize image /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG nova.objects.instance [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'migration_context' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1732004801',display_name='tempest-AttachVolumeTestJSON-server-1732004801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1732004801',id=30,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA==',key_name='tempest-keypair-529761837',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-phdutbkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=9741284c-15ce-41e3-934d-bf8f46a407f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG os_vif [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap884fdba5-50, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap884fdba5-50, col_values=(('external_ids', {'iface-id': '884fdba5-501f-4614-9e53-3e4b96a90630', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:c4:fa', 'vm-uuid': '9741284c-15ce-41e3-934d-bf8f46a407f5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:15:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:08 user nova-compute[71330]: INFO os_vif [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50')
Apr 14 12:15:09 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474494.498219, 11e4aa91-7c03-46cc-8610-78f18bbd089f => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:15:09 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] VM Stopped (Lifecycle Event)
Apr 14 12:15:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-3433bb90-e3cc-4755-8db3-c84d8e4db60b None None] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:15:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:10 user nova-compute[71330]: DEBUG nova.compute.manager [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:15:10 user nova-compute[71330]: WARNING nova.compute.manager [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state stopped and task_state powering-on.
Apr 14 12:15:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474512.015756, 9741284c-15ce-41e3-934d-bf8f46a407f5 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:15:12 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] VM Resumed (Lifecycle Event)
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:15:12 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance rebooted successfully.
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:15:12 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474512.0198803, 9741284c-15ce-41e3-934d-bf8f46a407f5 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:15:12 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] VM Started (Lifecycle Event)
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:15:12 user nova-compute[71330]: WARNING nova.compute.manager [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state active and task_state None.
Apr 14 12:15:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG nova.objects.instance [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:13 user nova-compute[71330]: INFO nova.compute.manager [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attaching volume c1260950-5599-449f-aff8-e310ecfe5cf6 to /dev/vdb
Apr 14 12:15:13 user nova-compute[71330]: DEBUG os_brick.utils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0994971e-4ecd-42cc-bd63-8f073f27a003]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e7fbe3-b69e-4850-92dc-c5a5df4155a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[063ec11a-b823-4c82-9234-7e72ac9568b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e3ddaa-252e-42e5-9862-04babc5f227a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:15:13 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:15:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a103db6e-84d4-455d-823c-14eb7b73e5b5]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG os_brick.utils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating existing volume attachment record: fcb7cfa4-8c95-4a1b-93ef-9d8aa74d6ead {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:15:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:14 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474499.0521421, b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:15:14 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] VM Stopped (Lifecycle Event)
Apr 14 12:15:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7320b4f2-a388-4f19-ad98-894685534321 None None] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:15:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:17 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474502.6710536, b350d4ef-74fe-4642-b1fd-4f15e10db590 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:15:17 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] VM Stopped (Lifecycle Event)
Apr 14 12:15:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-549df9e9-a63c-42f3-9e9d-3d2c521afd99 None None] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:15:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnxJaTsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:15:18 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:15:18 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:15:18 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[186773e1-bfce-4536-a099-54a02cf27322]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:15:18 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba7464-461c-4973-89e8-e6906d8e52b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6] added
Apr 14 12:15:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd8346f-2f3b-4a3b-93f0-fe2940d1d157]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b1c62-b1db-4467-9cc8-f04e5bfddb18]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnxJaTsz {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnxJaTsz" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2974b30-b7b6-4932-81e0-663f58a4ed1b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnxJaTsz'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e127c21-ae2d-4c61-8329-15c3462844d0]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[824fdf15-429f-4e00-90b4-46ba4bd37943]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:18 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:18 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecd3848-8d18-4460-a0b2-33bd16e51464]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6, portal: 172.16.0.220,3260]
Apr 14 12:15:18 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6, portal: 172.16.0.220,3260] successful.
Apr 14 12:15:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[591591a5-e7b6-4e76-83aa-b82bbfe6736c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c749283c-b4b2-479c-a779-02060f669505]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:18 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:18 user nova-compute[71330]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 (non-flash)
Apr 14 12:15:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:18 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:18 user nova-compute[71330]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 (non-flash)
Apr 14 12:15:18 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff36915-535b-4daf-a3a8-5489073e2e01]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnxJaTsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:15:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23164343037383639', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164343037383639', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG nova.objects.instance [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:15:19 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:15:19 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:15:19 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:15:19 user nova-compute[71330]:   <serial>c1260950-5599-449f-aff8-e310ecfe5cf6</serial>
Apr 14 12:15:19 user nova-compute[71330]: </disk>
Apr 14 12:15:19 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] No VIF found with MAC fa:16:3e:b2:30:0b, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.749s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Detaching volume c1260950-5599-449f-aff8-e310ecfe5cf6
Apr 14 12:15:21 user nova-compute[71330]: INFO nova.virt.block_device [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Attempting to driver detach volume c1260950-5599-449f-aff8-e310ecfe5cf6 from mountpoint /dev/vdb
Apr 14 12:15:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Attempting to detach device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:15:21 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:15:21 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:15:21 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:15:21 user nova-compute[71330]:   <serial>c1260950-5599-449f-aff8-e310ecfe5cf6</serial>
Apr 14 12:15:21 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:15:21 user nova-compute[71330]: </disk>
Apr 14 12:15:21 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:15:21 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully detached device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the persistent domain config.
Apr 14 12:15:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:15:21 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:15:21 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:15:21 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:15:21 user nova-compute[71330]:   <serial>c1260950-5599-449f-aff8-e310ecfe5cf6</serial>
Apr 14 12:15:21 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:15:21 user nova-compute[71330]: </disk>
Apr 14 12:15:21 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474521.7070909, a83e502a-7b98-4a46-ae3d-82339fbf07ca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:15:21 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully detached device vdb from instance a83e502a-7b98-4a46-ae3d-82339fbf07ca from the live domain config.
Apr 14 12:15:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnxJaTsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:15:21 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf95c326-2707-4845-82a1-d55d96bd2d14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:15:21 user nova-compute[71330]: No targets found.
Apr 14 12:15:21 user nova-compute[71330]: iSNS:
Apr 14 12:15:21 user nova-compute[71330]: No targets found.
Apr 14 12:15:21 user nova-compute[71330]: STATIC:
Apr 14 12:15:21 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6
Apr 14 12:15:21 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:15:21 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:15:21 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:15:21 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:15:21 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:15:21 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:15:21 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:15:21 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:15:21 user nova-compute[71330]: FIRMWARE:
Apr 14 12:15:21 user nova-compute[71330]: No targets found.
Apr 14 12:15:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:15:21 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:15:21 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31c8153-280f-45af-857c-d1afee780c9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[68939d1e-1f3f-49a6-9251-66814da48fa4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:21 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:21 user nova-compute[71330]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 (non-flash)
Apr 14 12:15:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:15:21 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:15:21 user nova-compute[71330]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 (non-flash)
Apr 14 12:15:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4954241480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39310e6-6a73-42b2-8aa7-e2edd12b007d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c944174-4cd3-4ef6-bb4d-f1f9d8d69077]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe6f191-3380-4f65-b2e7-f4bb68f37033]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[63acedb9-0ab4-4c58-9515-1665b38956b6]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5fc817-f722-4d50-83e7-1ca4bb3fc2be]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bade4c-02c7-45c7-a9d5-ed75b48afe64]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6, portal: 172.16.0.220,3260]
Apr 14 12:15:21 user nova-compute[71330]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6, portal: 172.16.0.220,3260] successful.
Apr 14 12:15:21 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1260950-5599-449f-aff8-e310ecfe5cf6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:22 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d9dd1a-d4e7-46a9-96f1-545c6e91a5a6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:15:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:15:22 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] <== disconnect_volume: return (303ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:15:22 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:15:22 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'flavor' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:15:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:15:45 user nova-compute[71330]: INFO nova.compute.claims [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Claim successful on node user
Apr 14 12:15:45 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:15:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:15:46 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.policy [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:15:46 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Creating image(s)
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "/opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "/opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "/opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.158s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.129s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk 1073741824" returned: 0 in 0.054s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Cannot resize image /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'migration_context' on Instance uuid 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Ensure instance console log exists: /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:46 user nova-compute[71330]: DEBUG nova.network.neutron [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Successfully created port: 04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Successfully updated port: 04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received event network-changed-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Refreshing instance network info cache due to event network-changed-04e58506-8191-400e-9aa7-bd8ffc6293ee. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] Acquiring lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:15:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.network.neutron [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updating instance_info_cache with network_info: [{"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Instance network_info: |[{"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] Acquired lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.network.neutron [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Refreshing network info cache for port 04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Start _get_guest_xml network_info=[{"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:15:48 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:15:48 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1318615277',display_name='tempest-ServerActionsTestJSON-server-1318615277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1318615277',id=33,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-6irb6wr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=88ea9bf2-f5e5-4629-a6e8-55a3ef69c654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:1a:61,bridge_name='br-int',has_traffic_filtering=True,id=04e58506-8191-400e-9aa7-bd8ffc6293ee,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e58506-81') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'pci_devices' on Instance uuid 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:15:48 user nova-compute[71330]:   <uuid>88ea9bf2-f5e5-4629-a6e8-55a3ef69c654</uuid>
Apr 14 12:15:48 user nova-compute[71330]:   <name>instance-00000021</name>
Apr 14 12:15:48 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:15:48 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:15:48 user nova-compute[71330]:   <metadata>
Apr 14 12:15:48 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:15:48 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:15:48 user nova-compute[71330]:       <nova:name>tempest-ServerActionsTestJSON-server-1318615277</nova:name>
Apr 14 12:15:48 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:15:48</nova:creationTime>
Apr 14 12:15:48 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:15:48 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:15:48 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:15:48 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:15:48 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:15:48 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:15:48 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:15:48 user nova-compute[71330]:       <nova:owner>
Apr 14 12:15:48 user nova-compute[71330]:         <nova:user uuid="7e264a59ff9b42e08095d0ce71e4d627">tempest-ServerActionsTestJSON-1592133549-project-member</nova:user>
Apr 14 12:15:48 user nova-compute[71330]:         <nova:project uuid="3e4ff63247dd4535bcd86acfde76fd34">tempest-ServerActionsTestJSON-1592133549</nova:project>
Apr 14 12:15:48 user nova-compute[71330]:       </nova:owner>
Apr 14 12:15:48 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:15:48 user nova-compute[71330]:       <nova:ports>
Apr 14 12:15:48 user nova-compute[71330]:         <nova:port uuid="04e58506-8191-400e-9aa7-bd8ffc6293ee">
Apr 14 12:15:48 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 12:15:48 user nova-compute[71330]:         </nova:port>
Apr 14 12:15:48 user nova-compute[71330]:       </nova:ports>
Apr 14 12:15:48 user nova-compute[71330]:     </nova:instance>
Apr 14 12:15:48 user nova-compute[71330]:   </metadata>
Apr 14 12:15:48 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:15:48 user nova-compute[71330]:     <system>
Apr 14 12:15:48 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:15:48 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:15:48 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:15:48 user nova-compute[71330]:       <entry name="serial">88ea9bf2-f5e5-4629-a6e8-55a3ef69c654</entry>
Apr 14 12:15:48 user nova-compute[71330]:       <entry name="uuid">88ea9bf2-f5e5-4629-a6e8-55a3ef69c654</entry>
Apr 14 12:15:48 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:15:48 user nova-compute[71330]:     </system>
Apr 14 12:15:48 user nova-compute[71330]:   </sysinfo>
Apr 14 12:15:48 user nova-compute[71330]:   <os>
Apr 14 12:15:48 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:15:48 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:15:48 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:15:48 user nova-compute[71330]:   </os>
Apr 14 12:15:48 user nova-compute[71330]:   <features>
Apr 14 12:15:48 user nova-compute[71330]:     <acpi/>
Apr 14 12:15:48 user nova-compute[71330]:     <apic/>
Apr 14 12:15:48 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:15:48 user nova-compute[71330]:   </features>
Apr 14 12:15:48 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:15:48 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:15:48 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:15:48 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:15:48 user nova-compute[71330]:   </clock>
Apr 14 12:15:48 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:15:48 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:15:48 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:15:48 user nova-compute[71330]:   </cpu>
Apr 14 12:15:48 user nova-compute[71330]:   <devices>
Apr 14 12:15:48 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:15:48 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:15:48 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk"/>
Apr 14 12:15:48 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:15:48 user nova-compute[71330]:     </disk>
Apr 14 12:15:48 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:15:48 user nova-compute[71330]:       <mac address="fa:16:3e:07:1a:61"/>
Apr 14 12:15:48 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:15:48 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:15:48 user nova-compute[71330]:       <target dev="tap04e58506-81"/>
Apr 14 12:15:48 user nova-compute[71330]:     </interface>
Apr 14 12:15:48 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:15:48 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/console.log" append="off"/>
Apr 14 12:15:48 user nova-compute[71330]:     </serial>
Apr 14 12:15:48 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:15:48 user nova-compute[71330]:     <video>
Apr 14 12:15:48 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:15:48 user nova-compute[71330]:     </video>
Apr 14 12:15:48 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:15:48 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:15:48 user nova-compute[71330]:     </rng>
Apr 14 12:15:48 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:15:48 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:15:48 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:15:48 user nova-compute[71330]:     </memballoon>
Apr 14 12:15:48 user nova-compute[71330]:   </devices>
Apr 14 12:15:48 user nova-compute[71330]: </domain>
Apr 14 12:15:48 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1318615277',display_name='tempest-ServerActionsTestJSON-server-1318615277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1318615277',id=33,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-6irb6wr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=88ea9bf2-f5e5-4629-a6e8-55a3ef69c654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:1a:61,bridge_name='br-int',has_traffic_filtering=True,id=04e58506-8191-400e-9aa7-bd8ffc6293ee,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e58506-81') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG os_vif [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:1a:61,bridge_name='br-int',has_traffic_filtering=True,id=04e58506-8191-400e-9aa7-bd8ffc6293ee,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e58506-81') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04e58506-81, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04e58506-81, col_values=(('external_ids', {'iface-id': '04e58506-8191-400e-9aa7-bd8ffc6293ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:1a:61', 'vm-uuid': '88ea9bf2-f5e5-4629-a6e8-55a3ef69c654'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:48 user nova-compute[71330]: INFO os_vif [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:1a:61,bridge_name='br-int',has_traffic_filtering=True,id=04e58506-8191-400e-9aa7-bd8ffc6293ee,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e58506-81')
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No VIF found with MAC fa:16:3e:07:1a:61, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.network.neutron [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updated VIF entry in instance network info cache for port 04e58506-8191-400e-9aa7-bd8ffc6293ee. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.network.neutron [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updating instance_info_cache with network_info: [{"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] Releasing lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "545be51c-649c-4297-a924-bbb6ecf303dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "545be51c-649c-4297-a924-bbb6ecf303dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:48 user nova-compute[71330]: INFO nova.compute.manager [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Terminating instance
Apr 14 12:15:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received event network-vif-unplugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] Acquiring lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] No waiting events found dispatching network-vif-unplugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received event network-vif-unplugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:15:49 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Instance destroyed successfully.
Apr 14 12:15:49 user nova-compute[71330]: DEBUG nova.objects.instance [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'resources' on Instance uuid 545be51c-649c-4297-a924-bbb6ecf303dd {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-247540869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-247540869',id=25,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:06:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-qi4jr6rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:08:23Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=545be51c-649c-4297-a924-bbb6ecf303dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "address": "fa:16:3e:e3:39:d1", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a8170c7-6a", "ovs_interfaceid": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:39:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a8170c7-6a56-4654-a6ef-95dc8f0957dd,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a8170c7-6a') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG os_vif [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:39:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a8170c7-6a56-4654-a6ef-95dc8f0957dd,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a8170c7-6a') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a8170c7-6a, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:49 user nova-compute[71330]: INFO os_vif [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:39:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a8170c7-6a56-4654-a6ef-95dc8f0957dd,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a8170c7-6a')
Apr 14 12:15:49 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Deleting instance files /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd_del
Apr 14 12:15:49 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Deletion of /opt/stack/data/nova/instances/545be51c-649c-4297-a924-bbb6ecf303dd_del complete
Apr 14 12:15:50 user nova-compute[71330]: INFO nova.compute.manager [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Took 1.10 seconds to destroy the instance on the hypervisor.
Apr 14 12:15:50 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received event network-vif-plugged-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] Acquiring lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] No waiting events found dispatching network-vif-plugged-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:15:50 user nova-compute[71330]: WARNING nova.compute.manager [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received unexpected event network-vif-plugged-04e58506-8191-400e-9aa7-bd8ffc6293ee for instance with vm_state building and task_state spawning.
Apr 14 12:15:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:15:50 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Took 0.77 seconds to deallocate network for instance.
Apr 14 12:15:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:51 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:15:51 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:15:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:51 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Deleted allocations for instance 545be51c-649c-4297-a924-bbb6ecf303dd
Apr 14 12:15:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "545be51c-649c-4297-a924-bbb6ecf303dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.310s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received event network-vif-plugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] Acquiring lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] Lock "545be51c-649c-4297-a924-bbb6ecf303dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] No waiting events found dispatching network-vif-plugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:15:51 user nova-compute[71330]: WARNING nova.compute.manager [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received unexpected event network-vif-plugged-2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance with vm_state deleted and task_state None.
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474552.0675232, 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:15:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] VM Resumed (Lifecycle Event)
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:15:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Instance spawned successfully.
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:15:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474552.0688663, 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:15:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] VM Started (Lifecycle Event)
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:15:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:15:52 user nova-compute[71330]: INFO nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Took 6.01 seconds to spawn the instance on the hypervisor.
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received event network-vif-plugged-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] Acquiring lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] No waiting events found dispatching network-vif-plugged-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:15:52 user nova-compute[71330]: WARNING nova.compute.manager [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received unexpected event network-vif-plugged-04e58506-8191-400e-9aa7-bd8ffc6293ee for instance with vm_state building and task_state spawning.
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Received event network-vif-deleted-2a8170c7-6a56-4654-a6ef-95dc8f0957dd {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:15:52 user nova-compute[71330]: INFO nova.compute.manager [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Took 6.66 seconds to build instance.
Apr 14 12:15:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.743s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:15:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:15:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:15:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:15:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:15:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "8b6f277a-7fde-43db-81be-ed9aaab827db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:15:59 user nova-compute[71330]: INFO nova.compute.claims [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Claim successful on node user
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:15:59 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:15:59 user nova-compute[71330]: INFO nova.virt.block_device [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Booting with volume e8c18af9-e524-4926-993c-10728f35875a at /dev/vda
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.policy [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG os_brick.utils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[533da597-bd98-44ee-b0d3-f0a4210efb35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ff8c22-9c7b-408d-bdd7-986a7d699383]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5adaef-7ff7-404b-94fc-4e2deeeae1c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2be266a-6417-459d-8aa8-26f02660cdf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:15:59 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:15:59 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[65334ded-5606-4027-8b42-081b638206a5]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG os_brick.utils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Updating existing volume attachment record: 7bdef220-db31-4ecd-bb34-f44b95789b5a {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:15:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Successfully created port: d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Successfully updated port: d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "refresh_cache-8b6f277a-7fde-43db-81be-ed9aaab827db" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquired lock "refresh_cache-8b6f277a-7fde-43db-81be-ed9aaab827db" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG nova.compute.manager [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received event network-changed-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG nova.compute.manager [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Refreshing instance network info cache due to event network-changed-d8cc6c06-b720-46c2-8074-a5dc8c7f743a. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] Acquiring lock "refresh_cache-8b6f277a-7fde-43db-81be-ed9aaab827db" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Updating instance_info_cache with network_info: [{"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Releasing lock "refresh_cache-8b6f277a-7fde-43db-81be-ed9aaab827db" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Instance network_info: |[{"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] Acquired lock "refresh_cache-8b6f277a-7fde-43db-81be-ed9aaab827db" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG nova.network.neutron [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Refreshing network info cache for port d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Updated VIF entry in instance network info cache for port d8cc6c06-b720-46c2-8074-a5dc8c7f743a. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Updating instance_info_cache with network_info: [{"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] Releasing lock "refresh_cache-8b6f277a-7fde-43db-81be-ed9aaab827db" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:03 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:16:03 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8219MB free_disk=26.194969177246094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance fcd74f51-099e-4c19-af7d-912f622fb153 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e745394e-1cf2-40d8-a7ec-003677309895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 8b6f277a-7fde-43db-81be-ed9aaab827db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:16:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:16:04 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Creating image(s)
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Ensure instance console log exists: /opt/stack/data/nova/instances/8b6f277a-7fde-43db-81be-ed9aaab827db/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Start _get_guest_xml network_info=[{"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '7bdef220-db31-4ecd-bb34-f44b95789b5a', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKBsfQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8b6f277a-7fde-43db-81be-ed9aaab827db', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8c18af9-e524-4926-993c-10728f35875a', 'serial': 'e8c18af9-e524-4926-993c-10728f35875a'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:16:04 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:16:04 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKBsfQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:16:04 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:16:04 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:16:04 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cd25b6-d5fa-4e84-a78d-b9702bdff3e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:16:04 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d59cca-4b78-4159-b0b8-fc60b55599d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a] added
Apr 14 12:16:04 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce223b21-e506-4c0a-b888-d1624d80bd13]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e073cf20-502b-4ca7-9bd1-8c78d7e97aae]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrKBsfQz {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrKBsfQz" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[14090848-f273-4a57-bf39-00fe46912a4e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vrKBsfQz'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474549.8559918, 545be51c-649c-4297-a924-bbb6ecf303dd => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:16:04 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] VM Stopped (Lifecycle Event)
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6dd002e0-d688-4e98-8de6-7d87018ba9ec None None] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c948f8c-3711-43d4-9512-4785aea37b1c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a1f01-7568-4608-9bf6-e7a3d3b007fc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:16:04 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:16:04 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:16:04 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:16:04 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2b62c6-ba7e-4756-8725-68cd03ef8061]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260]
Apr 14 12:16:04 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260] successful.
Apr 14 12:16:04 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a89975b-16d1-4546-9b41-e0c9da456b0f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcdc16a-cc0d-4bad-9e3c-1eba400f2b3f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:16:05 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:16:05 user nova-compute[71330]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:16:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:16:05 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:16:05 user nova-compute[71330]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:16:05 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f7ac72-7527-4d5b-9b7c-647823ac7e7f]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:05 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKBsfQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23933663963326433', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933663963326433', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:15:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-622304930',display_name='tempest-TestVolumeBootPattern-server-622304930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-622304930',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA==',key_name='tempest-TestVolumeBootPattern-582531121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-xt83yvvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:16:00Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=8b6f277a-7fde-43db-81be-ed9aaab827db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8cc6c06-b720-46c2-8074-a5dc8c7f743a,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cc6c06-b7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.objects.instance [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b6f277a-7fde-43db-81be-ed9aaab827db {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:16:06 user nova-compute[71330]:   <uuid>8b6f277a-7fde-43db-81be-ed9aaab827db</uuid>
Apr 14 12:16:06 user nova-compute[71330]:   <name>instance-00000022</name>
Apr 14 12:16:06 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:16:06 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:16:06 user nova-compute[71330]:   <metadata>
Apr 14 12:16:06 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:16:06 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:16:06 user nova-compute[71330]:       <nova:name>tempest-TestVolumeBootPattern-server-622304930</nova:name>
Apr 14 12:16:06 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:16:04</nova:creationTime>
Apr 14 12:16:06 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:16:06 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:16:06 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:16:06 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:16:06 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:16:06 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:16:06 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:16:06 user nova-compute[71330]:       <nova:owner>
Apr 14 12:16:06 user nova-compute[71330]:         <nova:user uuid="511fd95d993e4837a4a612385b04fdcb">tempest-TestVolumeBootPattern-2042813947-project-member</nova:user>
Apr 14 12:16:06 user nova-compute[71330]:         <nova:project uuid="0c317cb8d6a44115b216678540c433b6">tempest-TestVolumeBootPattern-2042813947</nova:project>
Apr 14 12:16:06 user nova-compute[71330]:       </nova:owner>
Apr 14 12:16:06 user nova-compute[71330]:       <nova:ports>
Apr 14 12:16:06 user nova-compute[71330]:         <nova:port uuid="d8cc6c06-b720-46c2-8074-a5dc8c7f743a">
Apr 14 12:16:06 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 12:16:06 user nova-compute[71330]:         </nova:port>
Apr 14 12:16:06 user nova-compute[71330]:       </nova:ports>
Apr 14 12:16:06 user nova-compute[71330]:     </nova:instance>
Apr 14 12:16:06 user nova-compute[71330]:   </metadata>
Apr 14 12:16:06 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:16:06 user nova-compute[71330]:     <system>
Apr 14 12:16:06 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:16:06 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:16:06 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:16:06 user nova-compute[71330]:       <entry name="serial">8b6f277a-7fde-43db-81be-ed9aaab827db</entry>
Apr 14 12:16:06 user nova-compute[71330]:       <entry name="uuid">8b6f277a-7fde-43db-81be-ed9aaab827db</entry>
Apr 14 12:16:06 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:16:06 user nova-compute[71330]:     </system>
Apr 14 12:16:06 user nova-compute[71330]:   </sysinfo>
Apr 14 12:16:06 user nova-compute[71330]:   <os>
Apr 14 12:16:06 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:16:06 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:16:06 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:16:06 user nova-compute[71330]:   </os>
Apr 14 12:16:06 user nova-compute[71330]:   <features>
Apr 14 12:16:06 user nova-compute[71330]:     <acpi/>
Apr 14 12:16:06 user nova-compute[71330]:     <apic/>
Apr 14 12:16:06 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:16:06 user nova-compute[71330]:   </features>
Apr 14 12:16:06 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:16:06 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:16:06 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:16:06 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:16:06 user nova-compute[71330]:   </clock>
Apr 14 12:16:06 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:16:06 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:16:06 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:16:06 user nova-compute[71330]:   </cpu>
Apr 14 12:16:06 user nova-compute[71330]:   <devices>
Apr 14 12:16:06 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:16:06 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:16:06 user nova-compute[71330]:       <source dev="/dev/sdc"/>
Apr 14 12:16:06 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:16:06 user nova-compute[71330]:       <serial>e8c18af9-e524-4926-993c-10728f35875a</serial>
Apr 14 12:16:06 user nova-compute[71330]:     </disk>
Apr 14 12:16:06 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:16:06 user nova-compute[71330]:       <mac address="fa:16:3e:61:fb:b2"/>
Apr 14 12:16:06 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:16:06 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:16:06 user nova-compute[71330]:       <target dev="tapd8cc6c06-b7"/>
Apr 14 12:16:06 user nova-compute[71330]:     </interface>
Apr 14 12:16:06 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:16:06 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/8b6f277a-7fde-43db-81be-ed9aaab827db/console.log" append="off"/>
Apr 14 12:16:06 user nova-compute[71330]:     </serial>
Apr 14 12:16:06 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:16:06 user nova-compute[71330]:     <video>
Apr 14 12:16:06 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:16:06 user nova-compute[71330]:     </video>
Apr 14 12:16:06 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:16:06 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:16:06 user nova-compute[71330]:     </rng>
Apr 14 12:16:06 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:16:06 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:16:06 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:16:06 user nova-compute[71330]:     </memballoon>
Apr 14 12:16:06 user nova-compute[71330]:   </devices>
Apr 14 12:16:06 user nova-compute[71330]: </domain>
Apr 14 12:16:06 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:15:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-622304930',display_name='tempest-TestVolumeBootPattern-server-622304930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-622304930',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA==',key_name='tempest-TestVolumeBootPattern-582531121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-xt83yvvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:16:00Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=8b6f277a-7fde-43db-81be-ed9aaab827db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8cc6c06-b720-46c2-8074-a5dc8c7f743a,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cc6c06-b7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG os_vif [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8cc6c06-b720-46c2-8074-a5dc8c7f743a,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cc6c06-b7') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8cc6c06-b7, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8cc6c06-b7, col_values=(('external_ids', {'iface-id': 'd8cc6c06-b720-46c2-8074-a5dc8c7f743a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:fb:b2', 'vm-uuid': '8b6f277a-7fde-43db-81be-ed9aaab827db'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:06 user nova-compute[71330]: INFO os_vif [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8cc6c06-b720-46c2-8074-a5dc8c7f743a,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cc6c06-b7')
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No VIF found with MAC fa:16:3e:61:fb:b2, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:16:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received event network-vif-plugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] Acquiring lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] No waiting events found dispatching network-vif-plugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:07 user nova-compute[71330]: WARNING nova.compute.manager [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received unexpected event network-vif-plugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance with vm_state building and task_state spawning.
Apr 14 12:16:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474569.4763725, 8b6f277a-7fde-43db-81be-ed9aaab827db => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:16:09 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] VM Resumed (Lifecycle Event)
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:16:09 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Instance spawned successfully.
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:09 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474569.4777, 8b6f277a-7fde-43db-81be-ed9aaab827db => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:16:09 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] VM Started (Lifecycle Event)
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:16:09 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:16:09 user nova-compute[71330]: INFO nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Took 4.90 seconds to spawn the instance on the hypervisor.
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received event network-vif-plugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] Acquiring lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] No waiting events found dispatching network-vif-plugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:09 user nova-compute[71330]: WARNING nova.compute.manager [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received unexpected event network-vif-plugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance with vm_state building and task_state spawning.
Apr 14 12:16:09 user nova-compute[71330]: INFO nova.compute.manager [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Took 10.52 seconds to build instance.
Apr 14 12:16:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.618s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received event network-changed-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Refreshing instance network info cache due to event network-changed-d1f86382-dd60-47d2-afae-5bbfd54c7489. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:16:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] Acquiring lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:16:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] Acquired lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:16:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Refreshing network info cache for port d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:16:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updated VIF entry in instance network info cache for port d1f86382-dd60-47d2-afae-5bbfd54c7489. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:16:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating instance_info_cache with network_info: [{"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:16:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] Releasing lock "refresh_cache-a83e502a-7b98-4a46-ae3d-82339fbf07ca" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:16:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:35 user nova-compute[71330]: INFO nova.compute.manager [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Terminating instance
Apr 14 12:16:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received event network-vif-unplugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] No waiting events found dispatching network-vif-unplugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received event network-vif-unplugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:16:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Instance destroyed successfully.
Apr 14 12:16:36 user nova-compute[71330]: DEBUG nova.objects.instance [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'resources' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-665226386',display_name='tempest-SnapshotDataIntegrityTests-server-665226386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-665226386',id=28,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeK2kkEDkG9iLiMYwLTjGqJrptZva+1c0p4rLwp6Kk8Ay66sIEsFK5byYYvBJZAtQ3XJxpD1thW71w6SHAc/DlHS3qz+eCj4QMPuTIrIFeoZQnSEs/TE6quNmIDzUDixQ==',key_name='tempest-SnapshotDataIntegrityTests-1808636935',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f89371d6c614961849733631ca6be66',ramdisk_id='',reservation_id='r-laxuwkyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-785189652',owner_user_name='tempest-SnapshotDataIntegrityTests-785189652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:10:08Z,user_data=None,user_id='f4e6f51853194dd7931111ff84ea10fb',uuid=a83e502a-7b98-4a46-ae3d-82339fbf07ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Converting VIF {"id": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "address": "fa:16:3e:b2:30:0b", "network": {"id": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-635633445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f89371d6c614961849733631ca6be66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f86382-dd", "ovs_interfaceid": "d1f86382-dd60-47d2-afae-5bbfd54c7489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:30:0b,bridge_name='br-int',has_traffic_filtering=True,id=d1f86382-dd60-47d2-afae-5bbfd54c7489,network=Network(c440d25d-1de9-42ef-b8fd-bb92d9a2a30d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f86382-dd') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG os_vif [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:30:0b,bridge_name='br-int',has_traffic_filtering=True,id=d1f86382-dd60-47d2-afae-5bbfd54c7489,network=Network(c440d25d-1de9-42ef-b8fd-bb92d9a2a30d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f86382-dd') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1f86382-dd, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:16:36 user nova-compute[71330]: INFO os_vif [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:30:0b,bridge_name='br-int',has_traffic_filtering=True,id=d1f86382-dd60-47d2-afae-5bbfd54c7489,network=Network(c440d25d-1de9-42ef-b8fd-bb92d9a2a30d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f86382-dd')
Apr 14 12:16:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Deleting instance files /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca_del
Apr 14 12:16:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Deletion of /opt/stack/data/nova/instances/a83e502a-7b98-4a46-ae3d-82339fbf07ca_del complete
Apr 14 12:16:36 user nova-compute[71330]: INFO nova.compute.manager [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 12:16:36 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:16:36 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:16:37 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:16:37 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Took 0.44 seconds to deallocate network for instance.
Apr 14 12:16:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received event network-vif-deleted-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:37 user nova-compute[71330]: INFO nova.compute.manager [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Neutron deleted interface d1f86382-dd60-47d2-afae-5bbfd54c7489; detaching it from the instance and deleting it from the info cache
Apr 14 12:16:37 user nova-compute[71330]: DEBUG nova.network.neutron [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:16:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Detach interface failed, port_id=d1f86382-dd60-47d2-afae-5bbfd54c7489, reason: Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:16:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:37 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:16:37 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:16:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:37 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Deleted allocations for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca
Apr 14 12:16:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.740s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received event network-vif-plugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] Acquiring lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] Lock "a83e502a-7b98-4a46-ae3d-82339fbf07ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] No waiting events found dispatching network-vif-plugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:38 user nova-compute[71330]: WARNING nova.compute.manager [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Received unexpected event network-vif-plugged-d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance with vm_state deleted and task_state None.
Apr 14 12:16:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "fcd74f51-099e-4c19-af7d-912f622fb153" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:39 user nova-compute[71330]: INFO nova.compute.manager [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Terminating instance
Apr 14 12:16:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-unplugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-unplugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-unplugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:40 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Instance destroyed successfully.
Apr 14 12:16:40 user nova-compute[71330]: DEBUG nova.objects.instance [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'resources' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-378271548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-378271548',id=14,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-66dlqwhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:04:41Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=fcd74f51-099e-4c19-af7d-912f622fb153,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "address": "fa:16:3e:75:f4:77", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7084b3b-06", "ovs_interfaceid": "a7084b3b-06c3-4e07-99fd-a37260b37f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=a7084b3b-06c3-4e07-99fd-a37260b37f29,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7084b3b-06') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_vif [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=a7084b3b-06c3-4e07-99fd-a37260b37f29,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7084b3b-06') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7084b3b-06, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:16:40 user nova-compute[71330]: INFO os_vif [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=a7084b3b-06c3-4e07-99fd-a37260b37f29,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7084b3b-06')
Apr 14 12:16:40 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHwghBUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:16:40 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef4ecc9-048f-4794-8a44-867b01f3f0de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:16:40 user nova-compute[71330]: No targets found.
Apr 14 12:16:40 user nova-compute[71330]: iSNS:
Apr 14 12:16:40 user nova-compute[71330]: No targets found.
Apr 14 12:16:40 user nova-compute[71330]: STATIC:
Apr 14 12:16:40 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a
Apr 14 12:16:40 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:16:40 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:16:40 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:16:40 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:16:40 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:16:40 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426
Apr 14 12:16:40 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:16:40 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:16:40 user nova-compute[71330]: FIRMWARE:
Apr 14 12:16:40 user nova-compute[71330]: No targets found.
Apr 14 12:16:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:16:40 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:16:40 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e36b3d-e350-41bf-a7c1-eacc7fd913c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbc6441-0ed7-4943-88b8-04c708a9000a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:16:40 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:16:40 user nova-compute[71330]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:16:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 (non-flash)
Apr 14 12:16:40 user nova-compute[71330]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:16:40 user nova-compute[71330]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:16:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4918516170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426'): ({'sde'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Removing single pathed devices sde {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c943ac6-a2ee-404e-8eed-26919ec066c5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[da19d21d-4266-4072-a460-5d2fda798515]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flushing IO for device /dev/sde {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bcc2b0-f96d-43cd-8ac4-ec4a4cfd9a13]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d689a1-e7b4-4f9e-bc49-a0bfbd74ebc7]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] SCSI volumes sde have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b0fd16-0f82-4d9c-a5c2-8379114bf2f6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbfeab3-3eaa-4685-bc81-2e5a1316bca3]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426, portal: 172.16.0.220,3260]
Apr 14 12:16:40 user nova-compute[71330]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426, portal: 172.16.0.220,3260] successful.
Apr 14 12:16:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c09b71-b72b-49b5-89f7-d78ad27fd426 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[25306a65-8436-47c7-a241-0810b0c614ae]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] <== disconnect_volume: return (290ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:16:40 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Deleting instance files /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153_del
Apr 14 12:16:40 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Deletion of /opt/stack/data/nova/instances/fcd74f51-099e-4c19-af7d-912f622fb153_del complete
Apr 14 12:16:40 user nova-compute[71330]: INFO nova.compute.manager [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 14 12:16:40 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:16:40 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:16:41 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Took 0.52 seconds to deallocate network for instance.
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "92742ea2-11c2-4701-aafc-4b49787881a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "92742ea2-11c2-4701-aafc-4b49787881a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:16:41 user nova-compute[71330]: INFO nova.compute.claims [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Claim successful on node user
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] Acquiring lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] Lock "fcd74f51-099e-4c19-af7d-912f622fb153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] No waiting events found dispatching network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:41 user nova-compute[71330]: WARNING nova.compute.manager [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received unexpected event network-vif-plugged-a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance with vm_state active and task_state deleting.
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Received event network-vif-deleted-a7084b3b-06c3-4e07-99fd-a37260b37f29 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:16:41 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:16:41 user nova-compute[71330]: INFO nova.compute.manager [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Took 0.84 seconds to detach 1 volumes for instance.
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.policy [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:16:41 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Creating image(s)
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "/opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "/opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "/opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk 1073741824" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:42 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Deleted allocations for instance fcd74f51-099e-4c19-af7d-912f622fb153
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "fcd74f51-099e-4c19-af7d-912f622fb153" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.252s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Successfully created port: 2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Cannot resize image /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lazy-loading 'migration_context' on Instance uuid 92742ea2-11c2-4701-aafc-4b49787881a4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Ensure instance console log exists: /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Successfully updated port: 2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "refresh_cache-92742ea2-11c2-4701-aafc-4b49787881a4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquired lock "refresh_cache-92742ea2-11c2-4701-aafc-4b49787881a4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Updating instance_info_cache with network_info: [{"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Releasing lock "refresh_cache-92742ea2-11c2-4701-aafc-4b49787881a4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Instance network_info: |[{"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Start _get_guest_xml network_info=[{"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:16:43 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:16:43 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:16:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1014012685',display_name='tempest-ServersNegativeTestJSON-server-1014012685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1014012685',id=35,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930c6e3aceb3445c8bed09847c92f271',ramdisk_id='',reservation_id='r-3xy4o5cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1103109288',owner_user_name='tempest-ServersNegativeTestJSON-1103109288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:16:42Z,user_data=None,user_id='f4063336b73e44ed991ca650d60bb3cd',uuid=92742ea2-11c2-4701-aafc-4b49787881a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converting VIF {"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:77:a2,bridge_name='br-int',has_traffic_filtering=True,id=2e478563-f11d-413c-8fba-e54ce2abb7ff,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e478563-f1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lazy-loading 'pci_devices' on Instance uuid 92742ea2-11c2-4701-aafc-4b49787881a4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.compute.manager [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received event network-changed-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.compute.manager [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Refreshing instance network info cache due to event network-changed-2e478563-f11d-413c-8fba-e54ce2abb7ff. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] Acquiring lock "refresh_cache-92742ea2-11c2-4701-aafc-4b49787881a4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] Acquired lock "refresh_cache-92742ea2-11c2-4701-aafc-4b49787881a4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.network.neutron [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Refreshing network info cache for port 2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:16:43 user nova-compute[71330]:   <uuid>92742ea2-11c2-4701-aafc-4b49787881a4</uuid>
Apr 14 12:16:43 user nova-compute[71330]:   <name>instance-00000023</name>
Apr 14 12:16:43 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:16:43 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:16:43 user nova-compute[71330]:   <metadata>
Apr 14 12:16:43 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:16:43 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:16:43 user nova-compute[71330]:       <nova:name>tempest-ServersNegativeTestJSON-server-1014012685</nova:name>
Apr 14 12:16:43 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:16:43</nova:creationTime>
Apr 14 12:16:43 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:16:43 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:16:43 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:16:43 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:16:43 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:16:43 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:16:43 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:16:43 user nova-compute[71330]:       <nova:owner>
Apr 14 12:16:43 user nova-compute[71330]:         <nova:user uuid="f4063336b73e44ed991ca650d60bb3cd">tempest-ServersNegativeTestJSON-1103109288-project-member</nova:user>
Apr 14 12:16:43 user nova-compute[71330]:         <nova:project uuid="930c6e3aceb3445c8bed09847c92f271">tempest-ServersNegativeTestJSON-1103109288</nova:project>
Apr 14 12:16:43 user nova-compute[71330]:       </nova:owner>
Apr 14 12:16:43 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:16:43 user nova-compute[71330]:       <nova:ports>
Apr 14 12:16:43 user nova-compute[71330]:         <nova:port uuid="2e478563-f11d-413c-8fba-e54ce2abb7ff">
Apr 14 12:16:43 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 12:16:43 user nova-compute[71330]:         </nova:port>
Apr 14 12:16:43 user nova-compute[71330]:       </nova:ports>
Apr 14 12:16:43 user nova-compute[71330]:     </nova:instance>
Apr 14 12:16:43 user nova-compute[71330]:   </metadata>
Apr 14 12:16:43 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:16:43 user nova-compute[71330]:     <system>
Apr 14 12:16:43 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:16:43 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:16:43 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:16:43 user nova-compute[71330]:       <entry name="serial">92742ea2-11c2-4701-aafc-4b49787881a4</entry>
Apr 14 12:16:43 user nova-compute[71330]:       <entry name="uuid">92742ea2-11c2-4701-aafc-4b49787881a4</entry>
Apr 14 12:16:43 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:16:43 user nova-compute[71330]:     </system>
Apr 14 12:16:43 user nova-compute[71330]:   </sysinfo>
Apr 14 12:16:43 user nova-compute[71330]:   <os>
Apr 14 12:16:43 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:16:43 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:16:43 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:16:43 user nova-compute[71330]:   </os>
Apr 14 12:16:43 user nova-compute[71330]:   <features>
Apr 14 12:16:43 user nova-compute[71330]:     <acpi/>
Apr 14 12:16:43 user nova-compute[71330]:     <apic/>
Apr 14 12:16:43 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:16:43 user nova-compute[71330]:   </features>
Apr 14 12:16:43 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:16:43 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:16:43 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:16:43 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:16:43 user nova-compute[71330]:   </clock>
Apr 14 12:16:43 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:16:43 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:16:43 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:16:43 user nova-compute[71330]:   </cpu>
Apr 14 12:16:43 user nova-compute[71330]:   <devices>
Apr 14 12:16:43 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:16:43 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:16:43 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk"/>
Apr 14 12:16:43 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:16:43 user nova-compute[71330]:     </disk>
Apr 14 12:16:43 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:16:43 user nova-compute[71330]:       <mac address="fa:16:3e:be:77:a2"/>
Apr 14 12:16:43 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:16:43 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:16:43 user nova-compute[71330]:       <target dev="tap2e478563-f1"/>
Apr 14 12:16:43 user nova-compute[71330]:     </interface>
Apr 14 12:16:43 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:16:43 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/console.log" append="off"/>
Apr 14 12:16:43 user nova-compute[71330]:     </serial>
Apr 14 12:16:43 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:16:43 user nova-compute[71330]:     <video>
Apr 14 12:16:43 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:16:43 user nova-compute[71330]:     </video>
Apr 14 12:16:43 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:16:43 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:16:43 user nova-compute[71330]:     </rng>
Apr 14 12:16:43 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:16:43 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:16:43 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:16:43 user nova-compute[71330]:     </memballoon>
Apr 14 12:16:43 user nova-compute[71330]:   </devices>
Apr 14 12:16:43 user nova-compute[71330]: </domain>
Apr 14 12:16:43 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:16:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1014012685',display_name='tempest-ServersNegativeTestJSON-server-1014012685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1014012685',id=35,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930c6e3aceb3445c8bed09847c92f271',ramdisk_id='',reservation_id='r-3xy4o5cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1103109288',owner_user_name='tempest-ServersNegativeTestJSON-1103109288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:16:42Z,user_data=None,user_id='f4063336b73e44ed991ca650d60bb3cd',uuid=92742ea2-11c2-4701-aafc-4b49787881a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converting VIF {"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:77:a2,bridge_name='br-int',has_traffic_filtering=True,id=2e478563-f11d-413c-8fba-e54ce2abb7ff,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e478563-f1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG os_vif [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:77:a2,bridge_name='br-int',has_traffic_filtering=True,id=2e478563-f11d-413c-8fba-e54ce2abb7ff,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e478563-f1') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e478563-f1, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e478563-f1, col_values=(('external_ids', {'iface-id': '2e478563-f11d-413c-8fba-e54ce2abb7ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:77:a2', 'vm-uuid': '92742ea2-11c2-4701-aafc-4b49787881a4'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:16:43 user nova-compute[71330]: INFO os_vif [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:77:a2,bridge_name='br-int',has_traffic_filtering=True,id=2e478563-f11d-413c-8fba-e54ce2abb7ff,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e478563-f1')
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:16:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] No VIF found with MAC fa:16:3e:be:77:a2, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:16:44 user nova-compute[71330]: DEBUG nova.network.neutron [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Updated VIF entry in instance network info cache for port 2e478563-f11d-413c-8fba-e54ce2abb7ff. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:16:44 user nova-compute[71330]: DEBUG nova.network.neutron [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Updating instance_info_cache with network_info: [{"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:16:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] Releasing lock "refresh_cache-92742ea2-11c2-4701-aafc-4b49787881a4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:16:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:45 user nova-compute[71330]: DEBUG nova.compute.manager [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received event network-vif-plugged-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] Acquiring lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:45 user nova-compute[71330]: DEBUG nova.compute.manager [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] No waiting events found dispatching network-vif-plugged-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:45 user nova-compute[71330]: WARNING nova.compute.manager [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received unexpected event network-vif-plugged-2e478563-f11d-413c-8fba-e54ce2abb7ff for instance with vm_state building and task_state spawning.
Apr 14 12:16:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474607.238431, 92742ea2-11c2-4701-aafc-4b49787881a4 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:16:47 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] VM Resumed (Lifecycle Event)
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:16:47 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Instance spawned successfully.
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:16:47 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474607.2401474, 92742ea2-11c2-4701-aafc-4b49787881a4 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:16:47 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] VM Started (Lifecycle Event)
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received event network-vif-plugged-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] Acquiring lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] No waiting events found dispatching network-vif-plugged-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:47 user nova-compute[71330]: WARNING nova.compute.manager [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received unexpected event network-vif-plugged-2e478563-f11d-413c-8fba-e54ce2abb7ff for instance with vm_state building and task_state spawning.
Apr 14 12:16:47 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:16:47 user nova-compute[71330]: INFO nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Took 5.42 seconds to spawn the instance on the hypervisor.
Apr 14 12:16:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:47 user nova-compute[71330]: INFO nova.compute.manager [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Took 6.15 seconds to build instance.
Apr 14 12:16:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "92742ea2-11c2-4701-aafc-4b49787881a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.243s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:49 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:16:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:16:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:16:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:16:49 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:16:49 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid 3a308eef-321e-45c9-bc63-f99c4eacef85 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:16:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:50 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updating instance_info_cache with network_info: [{"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:16:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-3a308eef-321e-45c9-bc63-f99c4eacef85" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:16:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:16:51 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474596.5947523, a83e502a-7b98-4a46-ae3d-82339fbf07ca => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:16:51 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] VM Stopped (Lifecycle Event)
Apr 14 12:16:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-af310c73-0af2-4e41-a6ad-d74c081752fc None None] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:16:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:55 user nova-compute[71330]: INFO nova.compute.manager [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Detaching volume 7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:16:55 user nova-compute[71330]: INFO nova.virt.block_device [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Attempting to driver detach volume 7daf6afe-aa4a-41fd-a6fd-2594e88abfdb from mountpoint /dev/vdb
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Attempting to detach device vdb from instance 9741284c-15ce-41e3-934d-bf8f46a407f5 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:16:55 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:16:55 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:16:55 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:16:55 user nova-compute[71330]:   <serial>7daf6afe-aa4a-41fd-a6fd-2594e88abfdb</serial>
Apr 14 12:16:55 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 12:16:55 user nova-compute[71330]: </disk>
Apr 14 12:16:55 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474600.1016912, fcd74f51-099e-4c19-af7d-912f622fb153 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:16:55 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] VM Stopped (Lifecycle Event)
Apr 14 12:16:55 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully detached device vdb from instance 9741284c-15ce-41e3-934d-bf8f46a407f5 from the persistent domain config.
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9741284c-15ce-41e3-934d-bf8f46a407f5 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:16:55 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:16:55 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:16:55 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:16:55 user nova-compute[71330]:   <serial>7daf6afe-aa4a-41fd-a6fd-2594e88abfdb</serial>
Apr 14 12:16:55 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 12:16:55 user nova-compute[71330]: </disk>
Apr 14 12:16:55 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-78114217-d987-424a-8f26-f48558523202 None None] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681474615.5334473, 9741284c-15ce-41e3-934d-bf8f46a407f5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:16:55 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully detached device vdb from instance 9741284c-15ce-41e3-934d-bf8f46a407f5 from the live domain config.
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psnPXVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:16:55 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc8df77-052b-485e-9b72-4c577a3c3ec0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:16:55 user nova-compute[71330]: No targets found.
Apr 14 12:16:55 user nova-compute[71330]: iSNS:
Apr 14 12:16:55 user nova-compute[71330]: No targets found.
Apr 14 12:16:55 user nova-compute[71330]: STATIC:
Apr 14 12:16:55 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a
Apr 14 12:16:55 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:16:55 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:16:55 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb
Apr 14 12:16:55 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:16:55 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:16:55 user nova-compute[71330]: FIRMWARE:
Apr 14 12:16:55 user nova-compute[71330]: No targets found.
Apr 14 12:16:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:16:55 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:16:55 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed61c3c-5ade-4c99-9e74-d8e77743e686]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[292dff20-3646-48b1-9858-99126900da59]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:16:55 user nova-compute[71330]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:16:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb (non-flash)
Apr 14 12:16:55 user nova-compute[71330]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:16:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4954129e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1affece8-5aaf-40a4-a846-1b96d6125a9f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3466e310-d67c-4191-8386-00b67cc2482e]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[38352858-6764-45a2-add9-282df3a11f01]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[daee7d37-5741-4be3-86b7-7f678976d2fd]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15df5b4-d1f2-4b18-ae1c-a0afcf2085d4]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1001a95f-70d2-4d94-9a5b-8a05e26adc3f]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260]
Apr 14 12:16:55 user nova-compute[71330]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb, portal: 172.16.0.220,3260] successful.
Apr 14 12:16:55 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daf6afe-aa4a-41fd-a6fd-2594e88abfdb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d63ff-db6c-4a24-9742-d8d058c80bbf]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== disconnect_volume: return (302ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:16:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:16:56 user nova-compute[71330]: DEBUG nova.objects.instance [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:16:56 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:56 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.645s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71330) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG nova.objects.instance [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-unplugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:57 user nova-compute[71330]: DEBUG nova.compute.manager [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-unplugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:57 user nova-compute[71330]: WARNING nova.compute.manager [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-unplugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state active and task_state powering-off.
Apr 14 12:16:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:58 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance destroyed successfully.
Apr 14 12:16:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:16:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.933s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:16:59 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:16:59 user nova-compute[71330]: DEBUG nova.compute.manager [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:16:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:16:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:16:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:16:59 user nova-compute[71330]: DEBUG nova.compute.manager [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:16:59 user nova-compute[71330]: WARNING nova.compute.manager [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state stopped and task_state None.
Apr 14 12:16:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:17:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:03 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:17:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:03 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:17:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:05 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:17:05 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8235MB free_disk=26.148590087890625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e745394e-1cf2-40d8-a7ec-003677309895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 8b6f277a-7fde-43db-81be-ed9aaab827db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 92742ea2-11c2-4701-aafc-4b49787881a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:17:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:17:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:13 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474618.138518, 9741284c-15ce-41e3-934d-bf8f46a407f5 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:17:13 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] VM Stopped (Lifecycle Event)
Apr 14 12:17:13 user nova-compute[71330]: DEBUG nova.compute.manager [None req-76ad00f7-f87f-4c1e-90da-40c6a40f6ced None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:17:13 user nova-compute[71330]: DEBUG nova.compute.manager [None req-76ad00f7-f87f-4c1e-90da-40c6a40f6ced None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:17:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "3a308eef-321e-45c9-bc63-f99c4eacef85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:30 user nova-compute[71330]: INFO nova.compute.manager [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Terminating instance
Apr 14 12:17:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received event network-vif-unplugged-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] Acquiring lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] No waiting events found dispatching network-vif-unplugged-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received event network-vif-unplugged-b417bb86-4450-4242-b710-0a5dd06d6777 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:17:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Instance destroyed successfully.
Apr 14 12:17:30 user nova-compute[71330]: DEBUG nova.objects.instance [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'resources' on Instance uuid 3a308eef-321e-45c9-bc63-f99c4eacef85 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441296803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441296803',id=6,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5140d4419e43be941c2ac5d5439e35',ramdisk_id='',reservation_id='r-lnhdenbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:59:00Z,user_data=None,user_id='11df88c60e4b456691d8731fe8facf38',uuid=3a308eef-321e-45c9-bc63-f99c4eacef85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converting VIF {"id": "b417bb86-4450-4242-b710-0a5dd06d6777", "address": "fa:16:3e:17:a7:39", "network": {"id": "609095b3-aa7f-45b1-a300-792fe3c6435a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1008845185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5140d4419e43be941c2ac5d5439e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb417bb86-44", "ovs_interfaceid": "b417bb86-4450-4242-b710-0a5dd06d6777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b417bb86-4450-4242-b710-0a5dd06d6777,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb417bb86-44') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG os_vif [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b417bb86-4450-4242-b710-0a5dd06d6777,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb417bb86-44') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb417bb86-44, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:17:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:30 user nova-compute[71330]: INFO os_vif [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b417bb86-4450-4242-b710-0a5dd06d6777,network=Network(609095b3-aa7f-45b1-a300-792fe3c6435a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb417bb86-44')
Apr 14 12:17:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Deleting instance files /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85_del
Apr 14 12:17:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Deletion of /opt/stack/data/nova/instances/3a308eef-321e-45c9-bc63-f99c4eacef85_del complete
Apr 14 12:17:31 user nova-compute[71330]: INFO nova.compute.manager [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 12:17:31 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:17:31 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:17:31 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:17:31 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:17:31 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Took 0.87 seconds to deallocate network for instance.
Apr 14 12:17:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:32 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:17:32 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:17:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:32 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Deleted allocations for instance 3a308eef-321e-45c9-bc63-f99c4eacef85
Apr 14 12:17:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received event network-vif-plugged-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] Acquiring lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] Lock "3a308eef-321e-45c9-bc63-f99c4eacef85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] No waiting events found dispatching network-vif-plugged-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:17:32 user nova-compute[71330]: WARNING nova.compute.manager [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received unexpected event network-vif-plugged-b417bb86-4450-4242-b710-0a5dd06d6777 for instance with vm_state deleted and task_state None.
Apr 14 12:17:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Received event network-vif-deleted-b417bb86-4450-4242-b710-0a5dd06d6777 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received event network-changed-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:36 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Refreshing instance network info cache due to event network-changed-04e58506-8191-400e-9aa7-bd8ffc6293ee. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:17:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] Acquiring lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:17:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] Acquired lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:17:36 user nova-compute[71330]: DEBUG nova.network.neutron [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Refreshing network info cache for port 04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:17:37 user nova-compute[71330]: DEBUG nova.network.neutron [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updated VIF entry in instance network info cache for port 04e58506-8191-400e-9aa7-bd8ffc6293ee. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:17:37 user nova-compute[71330]: DEBUG nova.network.neutron [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updating instance_info_cache with network_info: [{"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:17:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] Releasing lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:17:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:17:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:17:41 user nova-compute[71330]: INFO nova.compute.claims [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Claim successful on node user
Apr 14 12:17:42 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:17:42 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:17:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:17:42 user nova-compute[71330]: INFO nova.virt.block_device [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Booting with volume 9c761194-9415-479b-82d2-23b11346cb28 at /dev/vda
Apr 14 12:17:42 user nova-compute[71330]: DEBUG nova.policy [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG os_brick.utils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa632f65-8e2b-454b-a9e3-4cb0e7562c94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3bf534-2882-4acf-805b-1c765e6e4a8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffc5875-bbed-4e98-9060-20f3cd033efe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40172e7-7e4d-4a3a-8de9-ceaac4465030]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:17:42 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:17:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[23980156-1a12-46cc-aebd-afd3e06c7163]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG os_brick.utils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:17:42 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating existing volume attachment record: 3bd1c779-e041-40d5-9a3e-78f01a9a1437 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:17:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Successfully created port: 95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Successfully updated port: 95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-changed-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Refreshing instance network info cache due to event network-changed-95e757cd-56ba-460d-810a-2e9dd9d29919. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] Acquiring lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating instance_info_cache with network_info: [{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Instance network_info: |[{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] Acquired lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.network.neutron [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Refreshing network info cache for port 95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.network.neutron [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updated VIF entry in instance network info cache for port 95e757cd-56ba-460d-810a-2e9dd9d29919. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:17:44 user nova-compute[71330]: DEBUG nova.network.neutron [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating instance_info_cache with network_info: [{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:17:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] Releasing lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:17:45 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474650.9152675, 3a308eef-321e-45c9-bc63-f99c4eacef85 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:17:45 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] VM Stopped (Lifecycle Event)
Apr 14 12:17:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ee58f7c7-25cd-4889-abc1-9fb3374ea42d None None] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:17:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:17:47 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Creating image(s)
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Ensure instance console log exists: /opt/stack/data/nova/instances/1324bca1-ccba-417a-ac3d-c1828a0de879/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Start _get_guest_xml network_info=[{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '3bd1c779-e041-40d5-9a3e-78f01a9a1437', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruMcloJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1324bca1-ccba-417a-ac3d-c1828a0de879', 'attached_at': '', 'detached_at': '', 'volume_id': '9c761194-9415-479b-82d2-23b11346cb28', 'serial': '9c761194-9415-479b-82d2-23b11346cb28'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:17:47 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:17:47 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruMcloJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:17:47 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:17:47 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:17:47 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0060994-da7e-4f7e-b353-ff824f538fbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:17:47 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d22b3be-db61-422c-a924-fbba3ae8bb96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28] added
Apr 14 12:17:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b53b59d-5e10-4ddd-9b5e-aeef1969c688]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[de24e958-da12-4651-b372-5779156e2c48]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruMcloJQ {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruMcloJQ" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[460864d0-0e91-41e0-8fcc-a2454905b4c6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ruMcloJQ'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adbce9f-3f2b-479b-81a0-2259fae2f249]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e78c07-cf28-4090-9fb1-727f342d0cc0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:17:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:17:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c41cc19-87da-4300-9716-7e15fc76aa20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260]
Apr 14 12:17:47 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260] successful.
Apr 14 12:17:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[858cad86-6fee-42dc-998b-b303b04c200c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9e1dd2-7e4a-40ee-bafb-3c703d113a6c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:17:47 user nova-compute[71330]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:17:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:17:47 user nova-compute[71330]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:17:47 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[615d7d88-9e7a-41fb-8170-44df71ff903b]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:17:47 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruMcloJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26636653735333137', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636653735333137', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-770192826',display_name='tempest-ServerActionsTestJSON-server-770192826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-770192826',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-0gru5rw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=1324bca1-ccba-417a-ac3d-c1828a0de879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'pci_devices' on Instance uuid 1324bca1-ccba-417a-ac3d-c1828a0de879 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:17:48 user nova-compute[71330]:   <uuid>1324bca1-ccba-417a-ac3d-c1828a0de879</uuid>
Apr 14 12:17:48 user nova-compute[71330]:   <name>instance-00000024</name>
Apr 14 12:17:48 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:17:48 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:17:48 user nova-compute[71330]:   <metadata>
Apr 14 12:17:48 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:17:48 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:17:48 user nova-compute[71330]:       <nova:name>tempest-ServerActionsTestJSON-server-770192826</nova:name>
Apr 14 12:17:48 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:17:47</nova:creationTime>
Apr 14 12:17:48 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:17:48 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:17:48 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:17:48 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:17:48 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:17:48 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:17:48 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:17:48 user nova-compute[71330]:       <nova:owner>
Apr 14 12:17:48 user nova-compute[71330]:         <nova:user uuid="7e264a59ff9b42e08095d0ce71e4d627">tempest-ServerActionsTestJSON-1592133549-project-member</nova:user>
Apr 14 12:17:48 user nova-compute[71330]:         <nova:project uuid="3e4ff63247dd4535bcd86acfde76fd34">tempest-ServerActionsTestJSON-1592133549</nova:project>
Apr 14 12:17:48 user nova-compute[71330]:       </nova:owner>
Apr 14 12:17:48 user nova-compute[71330]:       <nova:ports>
Apr 14 12:17:48 user nova-compute[71330]:         <nova:port uuid="95e757cd-56ba-460d-810a-2e9dd9d29919">
Apr 14 12:17:48 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 12:17:48 user nova-compute[71330]:         </nova:port>
Apr 14 12:17:48 user nova-compute[71330]:       </nova:ports>
Apr 14 12:17:48 user nova-compute[71330]:     </nova:instance>
Apr 14 12:17:48 user nova-compute[71330]:   </metadata>
Apr 14 12:17:48 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:17:48 user nova-compute[71330]:     <system>
Apr 14 12:17:48 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:17:48 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:17:48 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:17:48 user nova-compute[71330]:       <entry name="serial">1324bca1-ccba-417a-ac3d-c1828a0de879</entry>
Apr 14 12:17:48 user nova-compute[71330]:       <entry name="uuid">1324bca1-ccba-417a-ac3d-c1828a0de879</entry>
Apr 14 12:17:48 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:17:48 user nova-compute[71330]:     </system>
Apr 14 12:17:48 user nova-compute[71330]:   </sysinfo>
Apr 14 12:17:48 user nova-compute[71330]:   <os>
Apr 14 12:17:48 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:17:48 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:17:48 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:17:48 user nova-compute[71330]:   </os>
Apr 14 12:17:48 user nova-compute[71330]:   <features>
Apr 14 12:17:48 user nova-compute[71330]:     <acpi/>
Apr 14 12:17:48 user nova-compute[71330]:     <apic/>
Apr 14 12:17:48 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:17:48 user nova-compute[71330]:   </features>
Apr 14 12:17:48 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:17:48 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:17:48 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:17:48 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:17:48 user nova-compute[71330]:   </clock>
Apr 14 12:17:48 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:17:48 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:17:48 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:17:48 user nova-compute[71330]:   </cpu>
Apr 14 12:17:48 user nova-compute[71330]:   <devices>
Apr 14 12:17:48 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:17:48 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:17:48 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 12:17:48 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:17:48 user nova-compute[71330]:       <serial>9c761194-9415-479b-82d2-23b11346cb28</serial>
Apr 14 12:17:48 user nova-compute[71330]:     </disk>
Apr 14 12:17:48 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:17:48 user nova-compute[71330]:       <mac address="fa:16:3e:30:39:a0"/>
Apr 14 12:17:48 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:17:48 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:17:48 user nova-compute[71330]:       <target dev="tap95e757cd-56"/>
Apr 14 12:17:48 user nova-compute[71330]:     </interface>
Apr 14 12:17:48 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:17:48 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/1324bca1-ccba-417a-ac3d-c1828a0de879/console.log" append="off"/>
Apr 14 12:17:48 user nova-compute[71330]:     </serial>
Apr 14 12:17:48 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:17:48 user nova-compute[71330]:     <video>
Apr 14 12:17:48 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:17:48 user nova-compute[71330]:     </video>
Apr 14 12:17:48 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:17:48 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:17:48 user nova-compute[71330]:     </rng>
Apr 14 12:17:48 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:17:48 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:17:48 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:17:48 user nova-compute[71330]:     </memballoon>
Apr 14 12:17:48 user nova-compute[71330]:   </devices>
Apr 14 12:17:48 user nova-compute[71330]: </domain>
Apr 14 12:17:48 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-770192826',display_name='tempest-ServerActionsTestJSON-server-770192826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-770192826',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-0gru5rw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=1324bca1-ccba-417a-ac3d-c1828a0de879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG os_vif [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95e757cd-56, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95e757cd-56, col_values=(('external_ids', {'iface-id': '95e757cd-56ba-460d-810a-2e9dd9d29919', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:39:a0', 'vm-uuid': '1324bca1-ccba-417a-ac3d-c1828a0de879'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:48 user nova-compute[71330]: INFO os_vif [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56')
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:17:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No VIF found with MAC fa:16:3e:30:39:a0, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] No waiting events found dispatching network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:17:50 user nova-compute[71330]: WARNING nova.compute.manager [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received unexpected event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 for instance with vm_state building and task_state spawning.
Apr 14 12:17:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "8b6f277a-7fde-43db-81be-ed9aaab827db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:51 user nova-compute[71330]: INFO nova.compute.manager [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Terminating instance
Apr 14 12:17:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received event network-vif-unplugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] Acquiring lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] No waiting events found dispatching network-vif-unplugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received event network-vif-unplugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474672.25752, 1324bca1-ccba-417a-ac3d-c1828a0de879 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] VM Resumed (Lifecycle Event)
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Instance spawned successfully.
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updating instance_info_cache with network_info: [{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474672.2624922, 1324bca1-ccba-417a-ac3d-c1828a0de879 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] VM Started (Lifecycle Event)
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Took 5.07 seconds to spawn the instance on the hypervisor.
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.compute.manager [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Took 10.56 seconds to build instance.
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Instance destroyed successfully.
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.objects.instance [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'resources' on Instance uuid 8b6f277a-7fde-43db-81be-ed9aaab827db {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:15:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-622304930',display_name='tempest-TestVolumeBootPattern-server-622304930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-622304930',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA==',key_name='tempest-TestVolumeBootPattern-582531121',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-xt83yvvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:16:10Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=8b6f277a-7fde-43db-81be-ed9aaab827db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8cc6c06-b720-46c2-8074-a5dc8c7f743a,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cc6c06-b7') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_vif [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8cc6c06-b720-46c2-8074-a5dc8c7f743a,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cc6c06-b7') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8cc6c06-b7, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] No waiting events found dispatching network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:17:52 user nova-compute[71330]: WARNING nova.compute.manager [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received unexpected event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 for instance with vm_state active and task_state None.
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received event network-changed-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Refreshing instance network info cache due to event network-changed-d8cc6c06-b720-46c2-8074-a5dc8c7f743a. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Acquiring lock "refresh_cache-8b6f277a-7fde-43db-81be-ed9aaab827db" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Acquired lock "refresh_cache-8b6f277a-7fde-43db-81be-ed9aaab827db" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.network.neutron [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Refreshing network info cache for port d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.690s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:52 user nova-compute[71330]: INFO os_vif [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:fb:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8cc6c06-b720-46c2-8074-a5dc8c7f743a,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cc6c06-b7')
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKBsfQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:17:52 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5e026c-7595-4fb0-a553-643f563185f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:17:52 user nova-compute[71330]: No targets found.
Apr 14 12:17:52 user nova-compute[71330]: iSNS:
Apr 14 12:17:52 user nova-compute[71330]: No targets found.
Apr 14 12:17:52 user nova-compute[71330]: STATIC:
Apr 14 12:17:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a
Apr 14 12:17:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:17:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:17:52 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28
Apr 14 12:17:52 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:17:52 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:17:52 user nova-compute[71330]: FIRMWARE:
Apr 14 12:17:52 user nova-compute[71330]: No targets found.
Apr 14 12:17:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:17:52 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:17:52 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[af14a6c0-3416-437b-925b-b4402394790f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb13c7-6e77-475c-8417-55c09a76b417]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:17:52 user nova-compute[71330]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:17:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:17:52 user nova-compute[71330]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:17:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962c4bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca90c7f-c11d-4cbb-b63a-b9318d15cd10]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7babfcce-8fc3-4322-8713-fa6adb3b1fd6]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3b42a2-12bd-4047-9abf-1d5b7ac67174]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46d5c29-d979-4945-8dda-0c0e02f313ac]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[30966436-22ba-472a-858e-381dba891b60]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e022b44f-cf6e-492c-8908-2a5b60c70ab1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260]
Apr 14 12:17:52 user nova-compute[71330]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260] successful.
Apr 14 12:17:52 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec084d6-154d-417d-95b1-6eb917c91529]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== disconnect_volume: return (315ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:17:52 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Deleting instance files /opt/stack/data/nova/instances/8b6f277a-7fde-43db-81be-ed9aaab827db_del
Apr 14 12:17:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Deletion of /opt/stack/data/nova/instances/8b6f277a-7fde-43db-81be-ed9aaab827db_del complete
Apr 14 12:17:53 user nova-compute[71330]: INFO nova.compute.manager [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Took 1.30 seconds to destroy the instance on the hypervisor.
Apr 14 12:17:53 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:17:53 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:17:53 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:17:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Updated VIF entry in instance network info cache for port d8cc6c06-b720-46c2-8074-a5dc8c7f743a. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:17:53 user nova-compute[71330]: DEBUG nova.network.neutron [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Updating instance_info_cache with network_info: [{"id": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "address": "fa:16:3e:61:fb:b2", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cc6c06-b7", "ovs_interfaceid": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:17:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Releasing lock "refresh_cache-8b6f277a-7fde-43db-81be-ed9aaab827db" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received event network-vif-plugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] Acquiring lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] No waiting events found dispatching network-vif-plugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:17:54 user nova-compute[71330]: WARNING nova.compute.manager [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received unexpected event network-vif-plugged-d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance with vm_state active and task_state deleting.
Apr 14 12:17:54 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Took 1.12 seconds to deallocate network for instance.
Apr 14 12:17:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-8d15a1fc-802b-44c0-80e2-e303db2b7246 req-aac125b8-276e-42ee-98d1-5dfeb902a302 service nova] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Received event network-vif-deleted-d8cc6c06-b720-46c2-8074-a5dc8c7f743a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] There are 0 instances to clean {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 12:17:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:55 user nova-compute[71330]: INFO nova.compute.manager [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Took 0.82 seconds to detach 1 volumes for instance.
Apr 14 12:17:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:17:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:17:55 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:17:55 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:17:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:55 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Deleted allocations for instance 8b6f277a-7fde-43db-81be-ed9aaab827db
Apr 14 12:17:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "8b6f277a-7fde-43db-81be-ed9aaab827db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.642s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:17:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:17:56 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:17:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:17:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:17:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:01 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:05 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:05 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:05 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474672.5222366, 8b6f277a-7fde-43db-81be-ed9aaab827db => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:18:07 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] VM Stopped (Lifecycle Event)
Apr 14 12:18:07 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:18:07 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8294MB free_disk=26.23685073852539GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-9060920e-2c27-49a5-a570-b087f86a763f None None] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e745394e-1cf2-40d8-a7ec-003677309895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 92742ea2-11c2-4701-aafc-4b49787881a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing inventories for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating ProviderTree inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing aggregate associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, aggregates: None {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 12:18:07 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing trait associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 12:18:08 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:18:08 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:18:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:18:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances with incomplete migration  {{(pid=71330) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 12:18:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:18:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "92742ea2-11c2-4701-aafc-4b49787881a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "92742ea2-11c2-4701-aafc-4b49787881a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:31 user nova-compute[71330]: INFO nova.compute.manager [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Terminating instance
Apr 14 12:18:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:18:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Instance destroyed successfully.
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.objects.instance [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lazy-loading 'resources' on Instance uuid 92742ea2-11c2-4701-aafc-4b49787881a4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:16:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1014012685',display_name='tempest-ServersNegativeTestJSON-server-1014012685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1014012685',id=35,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:16:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930c6e3aceb3445c8bed09847c92f271',ramdisk_id='',reservation_id='r-3xy4o5cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1103109288',owner_user_name='tempest-ServersNegativeTestJSON-1103109288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:16:47Z,user_data=None,user_id='f4063336b73e44ed991ca650d60bb3cd',uuid=92742ea2-11c2-4701-aafc-4b49787881a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converting VIF {"id": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "address": "fa:16:3e:be:77:a2", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e478563-f1", "ovs_interfaceid": "2e478563-f11d-413c-8fba-e54ce2abb7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:77:a2,bridge_name='br-int',has_traffic_filtering=True,id=2e478563-f11d-413c-8fba-e54ce2abb7ff,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e478563-f1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG os_vif [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:77:a2,bridge_name='br-int',has_traffic_filtering=True,id=2e478563-f11d-413c-8fba-e54ce2abb7ff,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e478563-f1') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e478563-f1, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:32 user nova-compute[71330]: INFO os_vif [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:77:a2,bridge_name='br-int',has_traffic_filtering=True,id=2e478563-f11d-413c-8fba-e54ce2abb7ff,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e478563-f1')
Apr 14 12:18:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Deleting instance files /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4_del
Apr 14 12:18:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Deletion of /opt/stack/data/nova/instances/92742ea2-11c2-4701-aafc-4b49787881a4_del complete
Apr 14 12:18:32 user nova-compute[71330]: INFO nova.compute.manager [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 14 12:18:32 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received event network-vif-unplugged-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] Acquiring lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] No waiting events found dispatching network-vif-unplugged-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received event network-vif-unplugged-2e478563-f11d-413c-8fba-e54ce2abb7ff for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:18:32 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Took 0.61 seconds to deallocate network for instance.
Apr 14 12:18:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-b6410ffb-b8d2-43c6-99fa-f9068c8bb1bf req-1030eec7-d653-4e8d-814d-c7139c11dcc2 service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received event network-vif-deleted-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:18:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:33 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Deleted allocations for instance 92742ea2-11c2-4701-aafc-4b49787881a4
Apr 14 12:18:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "92742ea2-11c2-4701-aafc-4b49787881a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received event network-vif-plugged-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:18:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] Acquiring lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] Lock "92742ea2-11c2-4701-aafc-4b49787881a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] No waiting events found dispatching network-vif-plugged-2e478563-f11d-413c-8fba-e54ce2abb7ff {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:18:34 user nova-compute[71330]: WARNING nova.compute.manager [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Received unexpected event network-vif-plugged-2e478563-f11d-413c-8fba-e54ce2abb7ff for instance with vm_state deleted and task_state None.
Apr 14 12:18:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "72e19f85-7f50-456a-a0af-b16e68471077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "72e19f85-7f50-456a-a0af-b16e68471077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:18:43 user nova-compute[71330]: INFO nova.compute.claims [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Claim successful on node user
Apr 14 12:18:43 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:18:43 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:18:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:18:43 user nova-compute[71330]: INFO nova.virt.block_device [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Booting with volume e8c18af9-e524-4926-993c-10728f35875a at /dev/vda
Apr 14 12:18:43 user nova-compute[71330]: DEBUG nova.policy [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG os_brick.utils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c097507b-44db-456b-bea6-c224097d1650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20da03c-b1ab-4b1d-ab32-7564fda3a734]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a6631-854f-4b3c-841f-f13f3bd92536]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b84285-246e-4fca-9759-adff96220bc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:18:44 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:18:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f59fa-02d4-4950-96dd-821b90fe3eb9]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG os_brick.utils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updating existing volume attachment record: 08c00562-09e8-4ee1-84ba-334a915e2466 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:18:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Successfully created port: 16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Successfully updated port: 16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquired lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG nova.compute.manager [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received event network-changed-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG nova.compute.manager [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Refreshing instance network info cache due to event network-changed-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] Acquiring lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updating instance_info_cache with network_info: [{"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Releasing lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Instance network_info: |[{"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] Acquired lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:18:45 user nova-compute[71330]: DEBUG nova.network.neutron [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Refreshing network info cache for port 16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:18:46 user nova-compute[71330]: DEBUG nova.network.neutron [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updated VIF entry in instance network info cache for port 16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:18:46 user nova-compute[71330]: DEBUG nova.network.neutron [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updating instance_info_cache with network_info: [{"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:18:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] Releasing lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:18:47 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474712.0075808, 92742ea2-11c2-4701-aafc-4b49787881a4 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:18:47 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] VM Stopped (Lifecycle Event)
Apr 14 12:18:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2b2f7c05-055a-408d-bc9d-71b2801b0451 None None] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:18:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:18:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquired lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:18:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:18:47 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'info_cache' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updating instance_info_cache with network_info: [{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Releasing lock "refresh_cache-9741284c-15ce-41e3-934d-bf8f46a407f5" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:18:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance destroyed successfully.
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'resources' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1732004801',display_name='tempest-AttachVolumeTestJSON-server-1732004801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1732004801',id=30,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA==',key_name='tempest-keypair-529761837',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-phdutbkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=9741284c-15ce-41e3-934d-bf8f46a407f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG os_vif [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap884fdba5-50, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:18:48 user nova-compute[71330]: INFO os_vif [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50')
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Start _get_guest_xml network_info=[{"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'numa_topology' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:48 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:18:48 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1732004801',display_name='tempest-AttachVolumeTestJSON-server-1732004801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1732004801',id=30,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA==',key_name='tempest-keypair-529761837',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-phdutbkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=9741284c-15ce-41e3-934d-bf8f46a407f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'pci_devices' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:18:48 user nova-compute[71330]:   <uuid>9741284c-15ce-41e3-934d-bf8f46a407f5</uuid>
Apr 14 12:18:48 user nova-compute[71330]:   <name>instance-0000001e</name>
Apr 14 12:18:48 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:18:48 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:18:48 user nova-compute[71330]:   <metadata>
Apr 14 12:18:48 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:18:48 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:18:48 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeTestJSON-server-1732004801</nova:name>
Apr 14 12:18:48 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:18:48</nova:creationTime>
Apr 14 12:18:48 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:18:48 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:18:48 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:18:48 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:18:48 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:18:48 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:18:48 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:18:48 user nova-compute[71330]:       <nova:owner>
Apr 14 12:18:48 user nova-compute[71330]:         <nova:user uuid="b7a65855384e4146a344cceb744e3e40">tempest-AttachVolumeTestJSON-341361172-project-member</nova:user>
Apr 14 12:18:48 user nova-compute[71330]:         <nova:project uuid="90ff3910da7c47e9828549306fda25d7">tempest-AttachVolumeTestJSON-341361172</nova:project>
Apr 14 12:18:48 user nova-compute[71330]:       </nova:owner>
Apr 14 12:18:48 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:18:48 user nova-compute[71330]:       <nova:ports>
Apr 14 12:18:48 user nova-compute[71330]:         <nova:port uuid="884fdba5-501f-4614-9e53-3e4b96a90630">
Apr 14 12:18:48 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 12:18:48 user nova-compute[71330]:         </nova:port>
Apr 14 12:18:48 user nova-compute[71330]:       </nova:ports>
Apr 14 12:18:48 user nova-compute[71330]:     </nova:instance>
Apr 14 12:18:48 user nova-compute[71330]:   </metadata>
Apr 14 12:18:48 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:18:48 user nova-compute[71330]:     <system>
Apr 14 12:18:48 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:18:48 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:18:48 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:18:48 user nova-compute[71330]:       <entry name="serial">9741284c-15ce-41e3-934d-bf8f46a407f5</entry>
Apr 14 12:18:48 user nova-compute[71330]:       <entry name="uuid">9741284c-15ce-41e3-934d-bf8f46a407f5</entry>
Apr 14 12:18:48 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:18:48 user nova-compute[71330]:     </system>
Apr 14 12:18:48 user nova-compute[71330]:   </sysinfo>
Apr 14 12:18:48 user nova-compute[71330]:   <os>
Apr 14 12:18:48 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:18:48 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:18:48 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:18:48 user nova-compute[71330]:   </os>
Apr 14 12:18:48 user nova-compute[71330]:   <features>
Apr 14 12:18:48 user nova-compute[71330]:     <acpi/>
Apr 14 12:18:48 user nova-compute[71330]:     <apic/>
Apr 14 12:18:48 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:18:48 user nova-compute[71330]:   </features>
Apr 14 12:18:48 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:18:48 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:18:48 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:18:48 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:18:48 user nova-compute[71330]:   </clock>
Apr 14 12:18:48 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:18:48 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:18:48 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:18:48 user nova-compute[71330]:   </cpu>
Apr 14 12:18:48 user nova-compute[71330]:   <devices>
Apr 14 12:18:48 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:18:48 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:18:48 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk"/>
Apr 14 12:18:48 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:18:48 user nova-compute[71330]:     </disk>
Apr 14 12:18:48 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:18:48 user nova-compute[71330]:       <mac address="fa:16:3e:30:c4:fa"/>
Apr 14 12:18:48 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:18:48 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:18:48 user nova-compute[71330]:       <target dev="tap884fdba5-50"/>
Apr 14 12:18:48 user nova-compute[71330]:     </interface>
Apr 14 12:18:48 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:18:48 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/console.log" append="off"/>
Apr 14 12:18:48 user nova-compute[71330]:     </serial>
Apr 14 12:18:48 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:18:48 user nova-compute[71330]:     <video>
Apr 14 12:18:48 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:18:48 user nova-compute[71330]:     </video>
Apr 14 12:18:48 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:18:48 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:18:48 user nova-compute[71330]:     </rng>
Apr 14 12:18:48 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:18:48 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:18:48 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:18:48 user nova-compute[71330]:     </memballoon>
Apr 14 12:18:48 user nova-compute[71330]:   </devices>
Apr 14 12:18:48 user nova-compute[71330]: </domain>
Apr 14 12:18:48 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Cannot resize image /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'migration_context' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1732004801',display_name='tempest-AttachVolumeTestJSON-server-1732004801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1732004801',id=30,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA==',key_name='tempest-keypair-529761837',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-phdutbkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=9741284c-15ce-41e3-934d-bf8f46a407f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_vif [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap884fdba5-50, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap884fdba5-50, col_values=(('external_ids', {'iface-id': '884fdba5-501f-4614-9e53-3e4b96a90630', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:c4:fa', 'vm-uuid': '9741284c-15ce-41e3-934d-bf8f46a407f5'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:49 user nova-compute[71330]: INFO os_vif [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50')
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:18:49 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Creating image(s)
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Ensure instance console log exists: /opt/stack/data/nova/instances/72e19f85-7f50-456a-a0af-b16e68471077/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Start _get_guest_xml network_info=[{"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '08c00562-09e8-4ee1-84ba-334a915e2466', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKBsfQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72e19f85-7f50-456a-a0af-b16e68471077', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8c18af9-e524-4926-993c-10728f35875a', 'serial': 'e8c18af9-e524-4926-993c-10728f35875a'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:18:49 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:18:49 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKBsfQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:18:49 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:18:49 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:18:49 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e197cdc-0ced-4497-b28b-11b61a055538]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:18:49 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbdee2c-7835-4db0-a33a-7a042aacd8f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a] added
Apr 14 12:18:49 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb39577-35a5-4d28-b674-82aea3b199a7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[87071f61-4d8e-4901-9bdf-36b9bcf19477]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrKBsfQz {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrKBsfQz" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[167d90f0-3f6c-4ed0-bf60-1f40025eb512]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vrKBsfQz'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecac6884-3817-430e-94e7-53545130c5c4]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6781d0c0-7fd9-4e0b-9a20-f7c9aa52b05c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:18:49 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:18:49 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b30b62f-3eda-4cc0-af2e-6acaf7ba3845]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260]
Apr 14 12:18:49 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260] successful.
Apr 14 12:18:49 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad43a28-7cc2-4822-8872-376d0435b54e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:49 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b045ff-0d18-4dce-bb31-e508f2bca05f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:18:50 user nova-compute[71330]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:18:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:18:50 user nova-compute[71330]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:18:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacd8a93-7754-4ffc-b2bb-e01e12b60ef9]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKBsfQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:18:50 user nova-compute[71330]: WARNING nova.compute.manager [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state stopped and task_state powering-on.
Apr 14 12:18:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23933663963326433', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933663963326433', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1722857272',display_name='tempest-TestVolumeBootPattern-server-1722857272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1722857272',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA==',key_name='tempest-TestVolumeBootPattern-582531121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-pa01ccjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:18:44Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=72e19f85-7f50-456a-a0af-b16e68471077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c54e3f-13') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.objects.instance [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'pci_devices' on Instance uuid 72e19f85-7f50-456a-a0af-b16e68471077 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:18:51 user nova-compute[71330]:   <uuid>72e19f85-7f50-456a-a0af-b16e68471077</uuid>
Apr 14 12:18:51 user nova-compute[71330]:   <name>instance-00000025</name>
Apr 14 12:18:51 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:18:51 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:18:51 user nova-compute[71330]:   <metadata>
Apr 14 12:18:51 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:18:51 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:18:51 user nova-compute[71330]:       <nova:name>tempest-TestVolumeBootPattern-server-1722857272</nova:name>
Apr 14 12:18:51 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:18:49</nova:creationTime>
Apr 14 12:18:51 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:18:51 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:18:51 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:18:51 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:18:51 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:18:51 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:18:51 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:18:51 user nova-compute[71330]:       <nova:owner>
Apr 14 12:18:51 user nova-compute[71330]:         <nova:user uuid="511fd95d993e4837a4a612385b04fdcb">tempest-TestVolumeBootPattern-2042813947-project-member</nova:user>
Apr 14 12:18:51 user nova-compute[71330]:         <nova:project uuid="0c317cb8d6a44115b216678540c433b6">tempest-TestVolumeBootPattern-2042813947</nova:project>
Apr 14 12:18:51 user nova-compute[71330]:       </nova:owner>
Apr 14 12:18:51 user nova-compute[71330]:       <nova:ports>
Apr 14 12:18:51 user nova-compute[71330]:         <nova:port uuid="16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e">
Apr 14 12:18:51 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 12:18:51 user nova-compute[71330]:         </nova:port>
Apr 14 12:18:51 user nova-compute[71330]:       </nova:ports>
Apr 14 12:18:51 user nova-compute[71330]:     </nova:instance>
Apr 14 12:18:51 user nova-compute[71330]:   </metadata>
Apr 14 12:18:51 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:18:51 user nova-compute[71330]:     <system>
Apr 14 12:18:51 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:18:51 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:18:51 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:18:51 user nova-compute[71330]:       <entry name="serial">72e19f85-7f50-456a-a0af-b16e68471077</entry>
Apr 14 12:18:51 user nova-compute[71330]:       <entry name="uuid">72e19f85-7f50-456a-a0af-b16e68471077</entry>
Apr 14 12:18:51 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:18:51 user nova-compute[71330]:     </system>
Apr 14 12:18:51 user nova-compute[71330]:   </sysinfo>
Apr 14 12:18:51 user nova-compute[71330]:   <os>
Apr 14 12:18:51 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:18:51 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:18:51 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:18:51 user nova-compute[71330]:   </os>
Apr 14 12:18:51 user nova-compute[71330]:   <features>
Apr 14 12:18:51 user nova-compute[71330]:     <acpi/>
Apr 14 12:18:51 user nova-compute[71330]:     <apic/>
Apr 14 12:18:51 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:18:51 user nova-compute[71330]:   </features>
Apr 14 12:18:51 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:18:51 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:18:51 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:18:51 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:18:51 user nova-compute[71330]:   </clock>
Apr 14 12:18:51 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:18:51 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:18:51 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:18:51 user nova-compute[71330]:   </cpu>
Apr 14 12:18:51 user nova-compute[71330]:   <devices>
Apr 14 12:18:51 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:18:51 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:18:51 user nova-compute[71330]:       <source dev="/dev/sdc"/>
Apr 14 12:18:51 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:18:51 user nova-compute[71330]:       <serial>e8c18af9-e524-4926-993c-10728f35875a</serial>
Apr 14 12:18:51 user nova-compute[71330]:     </disk>
Apr 14 12:18:51 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:18:51 user nova-compute[71330]:       <mac address="fa:16:3e:20:a9:68"/>
Apr 14 12:18:51 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:18:51 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:18:51 user nova-compute[71330]:       <target dev="tap16c54e3f-13"/>
Apr 14 12:18:51 user nova-compute[71330]:     </interface>
Apr 14 12:18:51 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:18:51 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/72e19f85-7f50-456a-a0af-b16e68471077/console.log" append="off"/>
Apr 14 12:18:51 user nova-compute[71330]:     </serial>
Apr 14 12:18:51 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:18:51 user nova-compute[71330]:     <video>
Apr 14 12:18:51 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:18:51 user nova-compute[71330]:     </video>
Apr 14 12:18:51 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:18:51 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:18:51 user nova-compute[71330]:     </rng>
Apr 14 12:18:51 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:18:51 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:18:51 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:18:51 user nova-compute[71330]:     </memballoon>
Apr 14 12:18:51 user nova-compute[71330]:   </devices>
Apr 14 12:18:51 user nova-compute[71330]: </domain>
Apr 14 12:18:51 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1722857272',display_name='tempest-TestVolumeBootPattern-server-1722857272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1722857272',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA==',key_name='tempest-TestVolumeBootPattern-582531121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-pa01ccjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:18:44Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=72e19f85-7f50-456a-a0af-b16e68471077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c54e3f-13') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG os_vif [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c54e3f-13') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16c54e3f-13, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16c54e3f-13, col_values=(('external_ids', {'iface-id': '16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:a9:68', 'vm-uuid': '72e19f85-7f50-456a-a0af-b16e68471077'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:51 user nova-compute[71330]: INFO os_vif [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c54e3f-13')
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No VIF found with MAC fa:16:3e:20:a9:68, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:18:51 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Updating instance_info_cache with network_info: [{"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received event network-vif-plugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] Acquiring lock "72e19f85-7f50-456a-a0af-b16e68471077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] No waiting events found dispatching network-vif-plugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:18:52 user nova-compute[71330]: WARNING nova.compute.manager [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received unexpected event network-vif-plugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance with vm_state building and task_state spawning.
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474732.8013647, 9741284c-15ce-41e3-934d-bf8f46a407f5 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:18:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] VM Resumed (Lifecycle Event)
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:18:52 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance rebooted successfully.
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:18:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474732.8057284, 9741284c-15ce-41e3-934d-bf8f46a407f5 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:18:52 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] VM Started (Lifecycle Event)
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:18:52 user nova-compute[71330]: WARNING nova.compute.manager [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state active and task_state None.
Apr 14 12:18:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received event network-vif-plugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] Acquiring lock "72e19f85-7f50-456a-a0af-b16e68471077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] No waiting events found dispatching network-vif-plugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:18:54 user nova-compute[71330]: WARNING nova.compute.manager [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received unexpected event network-vif-plugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance with vm_state building and task_state spawning.
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474734.8796148, 72e19f85-7f50-456a-a0af-b16e68471077 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:18:54 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] VM Resumed (Lifecycle Event)
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:18:54 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Instance spawned successfully.
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:18:54 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474734.8825347, 72e19f85-7f50-456a-a0af-b16e68471077 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:18:54 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] VM Started (Lifecycle Event)
Apr 14 12:18:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:18:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:18:54 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:18:55 user nova-compute[71330]: INFO nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Took 5.39 seconds to spawn the instance on the hypervisor.
Apr 14 12:18:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:18:55 user nova-compute[71330]: INFO nova.compute.manager [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Took 11.69 seconds to build instance.
Apr 14 12:18:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "72e19f85-7f50-456a-a0af-b16e68471077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.782s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:18:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:18:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:18:59 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "95db2830-1af3-49e6-af4b-bb8805db707a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "95db2830-1af3-49e6-af4b-bb8805db707a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:19:00 user nova-compute[71330]: INFO nova.compute.claims [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Claim successful on node user
Apr 14 12:19:00 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:19:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:19:01 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.policy [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e05e233f8bc749289056606d7046b38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9743d731274a493488bbf9df3d65d073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:19:01 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Creating image(s)
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "/opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "/opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "/opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk 1073741824" returned: 0 in 0.051s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Successfully created port: 54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Cannot resize image /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.objects.instance [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lazy-loading 'migration_context' on Instance uuid 95db2830-1af3-49e6-af4b-bb8805db707a {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Ensure instance console log exists: /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Successfully updated port: 54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "refresh_cache-95db2830-1af3-49e6-af4b-bb8805db707a" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquired lock "refresh_cache-95db2830-1af3-49e6-af4b-bb8805db707a" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received event network-changed-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Refreshing instance network info cache due to event network-changed-54a83467-5b88-4040-8edb-1bc984d9d179. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] Acquiring lock "refresh_cache-95db2830-1af3-49e6-af4b-bb8805db707a" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Updating instance_info_cache with network_info: [{"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Releasing lock "refresh_cache-95db2830-1af3-49e6-af4b-bb8805db707a" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Instance network_info: |[{"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] Acquired lock "refresh_cache-95db2830-1af3-49e6-af4b-bb8805db707a" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Refreshing network info cache for port 54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Start _get_guest_xml network_info=[{"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:19:02 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:19:02 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1643534439',display_name='tempest-VolumesActionsTest-instance-1643534439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1643534439',id=38,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9743d731274a493488bbf9df3d65d073',ramdisk_id='',reservation_id='r-dflyrx3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-993773268',owner_user_name='tempest-VolumesActionsTest-993773268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:19:01Z,user_data=None,user_id='e05e233f8bc749289056606d7046b38d',uuid=95db2830-1af3-49e6-af4b-bb8805db707a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converting VIF {"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=54a83467-5b88-4040-8edb-1bc984d9d179,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a83467-5b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.objects.instance [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lazy-loading 'pci_devices' on Instance uuid 95db2830-1af3-49e6-af4b-bb8805db707a {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:19:02 user nova-compute[71330]:   <uuid>95db2830-1af3-49e6-af4b-bb8805db707a</uuid>
Apr 14 12:19:02 user nova-compute[71330]:   <name>instance-00000026</name>
Apr 14 12:19:02 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:19:02 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:19:02 user nova-compute[71330]:   <metadata>
Apr 14 12:19:02 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:19:02 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:19:02 user nova-compute[71330]:       <nova:name>tempest-VolumesActionsTest-instance-1643534439</nova:name>
Apr 14 12:19:02 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:19:02</nova:creationTime>
Apr 14 12:19:02 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:19:02 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:19:02 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:19:02 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:19:02 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:19:02 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:19:02 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:19:02 user nova-compute[71330]:       <nova:owner>
Apr 14 12:19:02 user nova-compute[71330]:         <nova:user uuid="e05e233f8bc749289056606d7046b38d">tempest-VolumesActionsTest-993773268-project-member</nova:user>
Apr 14 12:19:02 user nova-compute[71330]:         <nova:project uuid="9743d731274a493488bbf9df3d65d073">tempest-VolumesActionsTest-993773268</nova:project>
Apr 14 12:19:02 user nova-compute[71330]:       </nova:owner>
Apr 14 12:19:02 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:19:02 user nova-compute[71330]:       <nova:ports>
Apr 14 12:19:02 user nova-compute[71330]:         <nova:port uuid="54a83467-5b88-4040-8edb-1bc984d9d179">
Apr 14 12:19:02 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 12:19:02 user nova-compute[71330]:         </nova:port>
Apr 14 12:19:02 user nova-compute[71330]:       </nova:ports>
Apr 14 12:19:02 user nova-compute[71330]:     </nova:instance>
Apr 14 12:19:02 user nova-compute[71330]:   </metadata>
Apr 14 12:19:02 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:19:02 user nova-compute[71330]:     <system>
Apr 14 12:19:02 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:19:02 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:19:02 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:19:02 user nova-compute[71330]:       <entry name="serial">95db2830-1af3-49e6-af4b-bb8805db707a</entry>
Apr 14 12:19:02 user nova-compute[71330]:       <entry name="uuid">95db2830-1af3-49e6-af4b-bb8805db707a</entry>
Apr 14 12:19:02 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:19:02 user nova-compute[71330]:     </system>
Apr 14 12:19:02 user nova-compute[71330]:   </sysinfo>
Apr 14 12:19:02 user nova-compute[71330]:   <os>
Apr 14 12:19:02 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:19:02 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:19:02 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:19:02 user nova-compute[71330]:   </os>
Apr 14 12:19:02 user nova-compute[71330]:   <features>
Apr 14 12:19:02 user nova-compute[71330]:     <acpi/>
Apr 14 12:19:02 user nova-compute[71330]:     <apic/>
Apr 14 12:19:02 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:19:02 user nova-compute[71330]:   </features>
Apr 14 12:19:02 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:19:02 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:19:02 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:19:02 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:19:02 user nova-compute[71330]:   </clock>
Apr 14 12:19:02 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:19:02 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:19:02 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:19:02 user nova-compute[71330]:   </cpu>
Apr 14 12:19:02 user nova-compute[71330]:   <devices>
Apr 14 12:19:02 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:19:02 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:19:02 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk"/>
Apr 14 12:19:02 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:19:02 user nova-compute[71330]:     </disk>
Apr 14 12:19:02 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:19:02 user nova-compute[71330]:       <mac address="fa:16:3e:e5:7e:86"/>
Apr 14 12:19:02 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:19:02 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:19:02 user nova-compute[71330]:       <target dev="tap54a83467-5b"/>
Apr 14 12:19:02 user nova-compute[71330]:     </interface>
Apr 14 12:19:02 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:19:02 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/console.log" append="off"/>
Apr 14 12:19:02 user nova-compute[71330]:     </serial>
Apr 14 12:19:02 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:19:02 user nova-compute[71330]:     <video>
Apr 14 12:19:02 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:19:02 user nova-compute[71330]:     </video>
Apr 14 12:19:02 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:19:02 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:19:02 user nova-compute[71330]:     </rng>
Apr 14 12:19:02 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:19:02 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:19:02 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:19:02 user nova-compute[71330]:     </memballoon>
Apr 14 12:19:02 user nova-compute[71330]:   </devices>
Apr 14 12:19:02 user nova-compute[71330]: </domain>
Apr 14 12:19:02 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1643534439',display_name='tempest-VolumesActionsTest-instance-1643534439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1643534439',id=38,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9743d731274a493488bbf9df3d65d073',ramdisk_id='',reservation_id='r-dflyrx3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-993773268',owner_user_name='tempest-VolumesActionsTest-993773268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:19:01Z,user_data=None,user_id='e05e233f8bc749289056606d7046b38d',uuid=95db2830-1af3-49e6-af4b-bb8805db707a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converting VIF {"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=54a83467-5b88-4040-8edb-1bc984d9d179,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a83467-5b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG os_vif [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=54a83467-5b88-4040-8edb-1bc984d9d179,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a83467-5b') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54a83467-5b, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54a83467-5b, col_values=(('external_ids', {'iface-id': '54a83467-5b88-4040-8edb-1bc984d9d179', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:7e:86', 'vm-uuid': '95db2830-1af3-49e6-af4b-bb8805db707a'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:19:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:02 user nova-compute[71330]: INFO os_vif [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=54a83467-5b88-4040-8edb-1bc984d9d179,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a83467-5b')
Apr 14 12:19:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:19:03 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] No VIF found with MAC fa:16:3e:e5:7e:86, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:19:03 user nova-compute[71330]: DEBUG nova.network.neutron [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Updated VIF entry in instance network info cache for port 54a83467-5b88-4040-8edb-1bc984d9d179. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:19:03 user nova-compute[71330]: DEBUG nova.network.neutron [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Updating instance_info_cache with network_info: [{"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:19:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] Releasing lock "refresh_cache-95db2830-1af3-49e6-af4b-bb8805db707a" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:19:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received event network-vif-plugged-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] Acquiring lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:04 user nova-compute[71330]: DEBUG nova.compute.manager [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] No waiting events found dispatching network-vif-plugged-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:19:04 user nova-compute[71330]: WARNING nova.compute.manager [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received unexpected event network-vif-plugged-54a83467-5b88-4040-8edb-1bc984d9d179 for instance with vm_state building and task_state spawning.
Apr 14 12:19:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:05 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474746.5368025, 95db2830-1af3-49e6-af4b-bb8805db707a => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:19:06 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] VM Resumed (Lifecycle Event)
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:19:06 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Instance spawned successfully.
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:19:06 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474746.5383217, 95db2830-1af3-49e6-af4b-bb8805db707a => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:19:06 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] VM Started (Lifecycle Event)
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:19:06 user nova-compute[71330]: INFO nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Took 5.51 seconds to spawn the instance on the hypervisor.
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received event network-vif-plugged-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] Acquiring lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] No waiting events found dispatching network-vif-plugged-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:19:06 user nova-compute[71330]: WARNING nova.compute.manager [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received unexpected event network-vif-plugged-54a83467-5b88-4040-8edb-1bc984d9d179 for instance with vm_state building and task_state spawning.
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:19:06 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:19:06 user nova-compute[71330]: INFO nova.compute.manager [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Took 6.18 seconds to build instance.
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "95db2830-1af3-49e6-af4b-bb8805db707a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.323s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:06 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:19:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8223MB free_disk=26.251354217529297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e745394e-1cf2-40d8-a7ec-003677309895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 72e19f85-7f50-456a-a0af-b16e68471077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 95db2830-1af3-49e6-af4b-bb8805db707a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:19:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:19:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:19:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:19:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:19:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received event network-changed-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:19:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Refreshing instance network info cache due to event network-changed-04e58506-8191-400e-9aa7-bd8ffc6293ee. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:19:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] Acquiring lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:19:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] Acquired lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:19:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Refreshing network info cache for port 04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:19:34 user nova-compute[71330]: DEBUG nova.network.neutron [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updated VIF entry in instance network info cache for port 04e58506-8191-400e-9aa7-bd8ffc6293ee. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:19:34 user nova-compute[71330]: DEBUG nova.network.neutron [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updating instance_info_cache with network_info: [{"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:19:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] Releasing lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:19:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Stashing vm_state: active {{(pid=71330) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'pci_requests' on Instance uuid 1324bca1-ccba-417a-ac3d-c1828a0de879 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:19:35 user nova-compute[71330]: INFO nova.compute.claims [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Claim successful on node user
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'resources' on Instance uuid 1324bca1-ccba-417a-ac3d-c1828a0de879 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'pci_devices' on Instance uuid 1324bca1-ccba-417a-ac3d-c1828a0de879 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:19:35 user nova-compute[71330]: INFO nova.compute.resource_tracker [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating resource usage from migration 4316685d-a85c-4df7-a749-74455fbc9778
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-changed-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Refreshing instance network info cache due to event network-changed-95e757cd-56ba-460d-810a-2e9dd9d29919. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] Acquiring lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] Acquired lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.network.neutron [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Refreshing network info cache for port 95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:19:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.402s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:35 user nova-compute[71330]: INFO nova.compute.manager [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Migrating
Apr 14 12:19:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:19:36 user nova-compute[71330]: DEBUG nova.network.neutron [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updated VIF entry in instance network info cache for port 95e757cd-56ba-460d-810a-2e9dd9d29919. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:19:36 user nova-compute[71330]: DEBUG nova.network.neutron [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating instance_info_cache with network_info: [{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:19:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] Releasing lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:19:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:19:36 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:19:36 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating instance_info_cache with network_info: [{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:19:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:19:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Starting migrate_disk_and_power_off {{(pid=71330) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-unplugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] No waiting events found dispatching network-vif-unplugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:19:37 user nova-compute[71330]: WARNING nova.compute.manager [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received unexpected event network-vif-unplugged-95e757cd-56ba-460d-810a-2e9dd9d29919 for instance with vm_state active and task_state resize_migrating.
Apr 14 12:19:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Instance destroyed successfully.
Apr 14 12:19:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-770192826',display_name='tempest-ServerActionsTestJSON-server-770192826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-770192826',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-0gru5rw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=1324bca1-ccba-417a-ac3d-c1828a0de879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:30:39:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:30:39:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_vif [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95e757cd-56, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:19:37 user nova-compute[71330]: INFO os_vif [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56')
Apr 14 12:19:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruMcloJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:19:37 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade78fd9-3a31-4a9f-b743-3cfcfb914c5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:19:37 user nova-compute[71330]: No targets found.
Apr 14 12:19:37 user nova-compute[71330]: iSNS:
Apr 14 12:19:37 user nova-compute[71330]: No targets found.
Apr 14 12:19:37 user nova-compute[71330]: STATIC:
Apr 14 12:19:37 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a
Apr 14 12:19:37 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:19:37 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:19:37 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28
Apr 14 12:19:37 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:19:37 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:19:37 user nova-compute[71330]: FIRMWARE:
Apr 14 12:19:37 user nova-compute[71330]: No targets found.
Apr 14 12:19:37 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:19:37 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:19:37 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bfcaa7-12ca-4638-870b-e6fc3f13f97a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cb4fdb-aec9-4b5c-ac6b-f0d89ac2c061]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:19:37 user nova-compute[71330]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:19:37 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:19:37 user nova-compute[71330]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:19:37 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962c4be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4632a8a9-1ec9-412f-9096-12ba8e6d3b32]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99993c0-4bd8-4492-b8aa-9aea59c2ace2]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[958b7936-25e7-4dce-a955-93056f60372b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc18cba-c899-40ba-855d-a4cbeb279325]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85500aa-023a-4afb-b27f-2e9850dde544]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5121fa94-d2f0-49f1-97fa-486916797e7a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260]
Apr 14 12:19:38 user nova-compute[71330]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260] successful.
Apr 14 12:19:38 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c020bc8-f639-43ed-b782-848b888ce476]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== disconnect_volume: return (298ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:19:38 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Port 95e757cd-56ba-460d-810a-2e9dd9d29919 binding to destination host user is already ACTIVE {{(pid=71330) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] No waiting events found dispatching network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:19:39 user nova-compute[71330]: WARNING nova.compute.manager [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received unexpected event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 for instance with vm_state active and task_state resize_migrated.
Apr 14 12:19:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating instance_info_cache with network_info: [{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG os_brick.utils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7173369a-afab-499f-be29-0172f24a5e2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5a096e-1ad7-49eb-bf54-3dd7af03b7a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2b459d-ffc0-4a51-b8aa-4b86e1c7ef1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7fc59f-4932-4564-aa52-05e8decbc7fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:19:40 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:19:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f146854f-b592-4704-9705-aef61d10f2e7]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:19:40 user nova-compute[71330]: DEBUG os_brick.utils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:19:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Starting finish_migration {{(pid=71330) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Instance directory exists: not creating {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 12:19:44 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Creating image(s)
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Ensure instance console log exists: /opt/stack/data/nova/instances/1324bca1-ccba-417a-ac3d-c1828a0de879/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Start _get_guest_xml network_info=[{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:30:39:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'db3212d3-180a-4f69-924d-ccab1e236643', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruMcloJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1324bca1-ccba-417a-ac3d-c1828a0de879', 'attached_at': '2023-04-14T12:19:44.000000', 'detached_at': '', 'volume_id': '9c761194-9415-479b-82d2-23b11346cb28', 'serial': '9c761194-9415-479b-82d2-23b11346cb28'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:19:44 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:19:44 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1324bca1-ccba-417a-ac3d-c1828a0de879 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruMcloJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:19:44 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:19:44 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:19:44 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[104d6c7b-601c-4d7c-a40c-bde40f87a745]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:19:44 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa4af92-9282-4f03-9831-4f788e70a935]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28] added
Apr 14 12:19:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c094581-b689-45ac-a915-2c8b4f1aa220]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3a9375-6aa3-4765-bc35-1510db2da68b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruMcloJQ {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruMcloJQ" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c10097-b7cf-487b-84e9-62d144c0860d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ruMcloJQ'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[37037c1e-ef87-4bf9-91a9-01961c74fc97]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[53914eed-8fc1-4d07-9409-a9bfc4f5d63a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:19:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:19:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee6bbd4-118e-42e2-a404-cb1f8611d346]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260]
Apr 14 12:19:44 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260] successful.
Apr 14 12:19:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[79da669c-9917-44e6-8a1d-0ab76336cf7e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ded668-51ee-4296-9943-87b7bbd34a21]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:19:44 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:19:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:19:44 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:19:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[965ce88a-19d6-4f60-baa0-c9e71d374137]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:19:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruMcloJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:19:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:19:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26636653735333137', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:19:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636653735333137', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:19:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-770192826',display_name='tempest-ServerActionsTestJSON-server-770192826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-770192826',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-0gru5rw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=1324bca1-ccba-417a-ac3d-c1828a0de879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:30:39:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:19:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:30:39:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:19:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:19:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:19:45 user nova-compute[71330]:   <uuid>1324bca1-ccba-417a-ac3d-c1828a0de879</uuid>
Apr 14 12:19:45 user nova-compute[71330]:   <name>instance-00000024</name>
Apr 14 12:19:45 user nova-compute[71330]:   <memory>196608</memory>
Apr 14 12:19:45 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:19:45 user nova-compute[71330]:   <metadata>
Apr 14 12:19:45 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:19:45 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:19:45 user nova-compute[71330]:       <nova:name>tempest-ServerActionsTestJSON-server-770192826</nova:name>
Apr 14 12:19:45 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:19:44</nova:creationTime>
Apr 14 12:19:45 user nova-compute[71330]:       <nova:flavor name="m1.micro">
Apr 14 12:19:45 user nova-compute[71330]:         <nova:memory>192</nova:memory>
Apr 14 12:19:45 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:19:45 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:19:45 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:19:45 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:19:45 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:19:45 user nova-compute[71330]:       <nova:owner>
Apr 14 12:19:45 user nova-compute[71330]:         <nova:user uuid="7e264a59ff9b42e08095d0ce71e4d627">tempest-ServerActionsTestJSON-1592133549-project-member</nova:user>
Apr 14 12:19:45 user nova-compute[71330]:         <nova:project uuid="3e4ff63247dd4535bcd86acfde76fd34">tempest-ServerActionsTestJSON-1592133549</nova:project>
Apr 14 12:19:45 user nova-compute[71330]:       </nova:owner>
Apr 14 12:19:45 user nova-compute[71330]:       <nova:ports>
Apr 14 12:19:45 user nova-compute[71330]:         <nova:port uuid="95e757cd-56ba-460d-810a-2e9dd9d29919">
Apr 14 12:19:45 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 12:19:45 user nova-compute[71330]:         </nova:port>
Apr 14 12:19:45 user nova-compute[71330]:       </nova:ports>
Apr 14 12:19:45 user nova-compute[71330]:     </nova:instance>
Apr 14 12:19:45 user nova-compute[71330]:   </metadata>
Apr 14 12:19:45 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:19:45 user nova-compute[71330]:     <system>
Apr 14 12:19:45 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:19:45 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:19:45 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:19:45 user nova-compute[71330]:       <entry name="serial">1324bca1-ccba-417a-ac3d-c1828a0de879</entry>
Apr 14 12:19:45 user nova-compute[71330]:       <entry name="uuid">1324bca1-ccba-417a-ac3d-c1828a0de879</entry>
Apr 14 12:19:45 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:19:45 user nova-compute[71330]:     </system>
Apr 14 12:19:45 user nova-compute[71330]:   </sysinfo>
Apr 14 12:19:45 user nova-compute[71330]:   <os>
Apr 14 12:19:45 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:19:45 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:19:45 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:19:45 user nova-compute[71330]:   </os>
Apr 14 12:19:45 user nova-compute[71330]:   <features>
Apr 14 12:19:45 user nova-compute[71330]:     <acpi/>
Apr 14 12:19:45 user nova-compute[71330]:     <apic/>
Apr 14 12:19:45 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:19:45 user nova-compute[71330]:   </features>
Apr 14 12:19:45 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:19:45 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:19:45 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:19:45 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:19:45 user nova-compute[71330]:   </clock>
Apr 14 12:19:45 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:19:45 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:19:45 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:19:45 user nova-compute[71330]:   </cpu>
Apr 14 12:19:45 user nova-compute[71330]:   <devices>
Apr 14 12:19:45 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:19:45 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:19:45 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 12:19:45 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:19:45 user nova-compute[71330]:       <serial>9c761194-9415-479b-82d2-23b11346cb28</serial>
Apr 14 12:19:45 user nova-compute[71330]:     </disk>
Apr 14 12:19:45 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:19:45 user nova-compute[71330]:       <mac address="fa:16:3e:30:39:a0"/>
Apr 14 12:19:45 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:19:45 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:19:45 user nova-compute[71330]:       <target dev="tap95e757cd-56"/>
Apr 14 12:19:45 user nova-compute[71330]:     </interface>
Apr 14 12:19:45 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:19:45 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/1324bca1-ccba-417a-ac3d-c1828a0de879/console.log" append="off"/>
Apr 14 12:19:45 user nova-compute[71330]:     </serial>
Apr 14 12:19:45 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:19:45 user nova-compute[71330]:     <video>
Apr 14 12:19:45 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:19:45 user nova-compute[71330]:     </video>
Apr 14 12:19:45 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:19:45 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:19:45 user nova-compute[71330]:     </rng>
Apr 14 12:19:45 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:19:45 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:19:45 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:19:45 user nova-compute[71330]:     </memballoon>
Apr 14 12:19:45 user nova-compute[71330]:   </devices>
Apr 14 12:19:45 user nova-compute[71330]: </domain>
Apr 14 12:19:45 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-770192826',display_name='tempest-ServerActionsTestJSON-server-770192826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-770192826',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-0gru5rw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=1324bca1-ccba-417a-ac3d-c1828a0de879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:30:39:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-488843070-network", "vif_mac": "fa:16:3e:30:39:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG os_vif [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95e757cd-56, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95e757cd-56, col_values=(('external_ids', {'iface-id': '95e757cd-56ba-460d-810a-2e9dd9d29919', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:39:a0', 'vm-uuid': '1324bca1-ccba-417a-ac3d-c1828a0de879'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:46 user nova-compute[71330]: INFO os_vif [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56')
Apr 14 12:19:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:19:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] No VIF found with MAC fa:16:3e:30:39:a0, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:19:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:19:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] No waiting events found dispatching network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:19:47 user nova-compute[71330]: WARNING nova.compute.manager [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received unexpected event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 for instance with vm_state active and task_state resize_finish.
Apr 14 12:19:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.host [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Removed pending event for 1324bca1-ccba-417a-ac3d-c1828a0de879 due to event {{(pid=71330) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474789.43831, 1324bca1-ccba-417a-ac3d-c1828a0de879 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:19:49 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] VM Resumed (Lifecycle Event)
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:19:49 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Instance running successfully.
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Failed to set time: agent not configured {{(pid=71330) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] finish_migration finished successfully. {{(pid=71330) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:19:49 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474789.4395022, 1324bca1-ccba-417a-ac3d-c1828a0de879 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:19:49 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] VM Started (Lifecycle Event)
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:19:49 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:19:49 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] No waiting events found dispatching network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:19:49 user nova-compute[71330]: WARNING nova.compute.manager [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received unexpected event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 for instance with vm_state active and task_state resize_finish.
Apr 14 12:19:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:19:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:19:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:19:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:19:54 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:19:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:55 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updating instance_info_cache with network_info: [{"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:19:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:19:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:19:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:19:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:19:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:19:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:19:58 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:19:58 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:19:59 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:20:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:20:04 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:20:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:05 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:20:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:20:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:20:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:09 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:20:09 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8227MB free_disk=26.22315216064453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Applying migration context for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 as it has an incoming, in-progress migration 4316685d-a85c-4df7-a749-74455fbc9778. Migration status is finished {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 12:20:09 user nova-compute[71330]: INFO nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating resource usage from migration 4316685d-a85c-4df7-a749-74455fbc9778
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e745394e-1cf2-40d8-a7ec-003677309895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 72e19f85-7f50-456a-a0af-b16e68471077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 95db2830-1af3-49e6-af4b-bb8805db707a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Migration 4316685d-a85c-4df7-a749-74455fbc9778 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:20:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:20:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:20:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:20:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:20:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received event network-changed-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Refreshing instance network info cache due to event network-changed-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:20:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] Acquiring lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:20:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] Acquired lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:20:35 user nova-compute[71330]: DEBUG nova.network.neutron [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Refreshing network info cache for port 16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:20:36 user nova-compute[71330]: DEBUG nova.network.neutron [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updated VIF entry in instance network info cache for port 16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:20:36 user nova-compute[71330]: DEBUG nova.network.neutron [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updating instance_info_cache with network_info: [{"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:20:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] Releasing lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:20:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:38 user nova-compute[71330]: INFO nova.compute.manager [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Terminating instance
Apr 14 12:20:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-unplugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-unplugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-unplugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:39 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Instance destroyed successfully.
Apr 14 12:20:39 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'resources' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1732004801',display_name='tempest-AttachVolumeTestJSON-server-1732004801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1732004801',id=30,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA==',key_name='tempest-keypair-529761837',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-phdutbkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=9741284c-15ce-41e3-934d-bf8f46a407f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "884fdba5-501f-4614-9e53-3e4b96a90630", "address": "fa:16:3e:30:c4:fa", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884fdba5-50", "ovs_interfaceid": "884fdba5-501f-4614-9e53-3e4b96a90630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG os_vif [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap884fdba5-50, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:39 user nova-compute[71330]: INFO os_vif [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c4:fa,bridge_name='br-int',has_traffic_filtering=True,id=884fdba5-501f-4614-9e53-3e4b96a90630,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884fdba5-50')
Apr 14 12:20:39 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Deleting instance files /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5_del
Apr 14 12:20:39 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Deletion of /opt/stack/data/nova/instances/9741284c-15ce-41e3-934d-bf8f46a407f5_del complete
Apr 14 12:20:39 user nova-compute[71330]: INFO nova.compute.manager [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 12:20:39 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:20:39 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:20:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:40 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:20:40 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Took 0.84 seconds to deallocate network for instance.
Apr 14 12:20:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-4136f0a9-35c8-4264-83ae-951a25a282f4 req-64628691-f335-4ad0-a2fa-09c64f7c2214 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-deleted-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:40 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:20:40 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:20:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:40 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Deleted allocations for instance 9741284c-15ce-41e3-934d-bf8f46a407f5
Apr 14 12:20:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] Acquiring lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] Lock "9741284c-15ce-41e3-934d-bf8f46a407f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] No waiting events found dispatching network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:20:41 user nova-compute[71330]: WARNING nova.compute.manager [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Received unexpected event network-vif-plugged-884fdba5-501f-4614-9e53-3e4b96a90630 for instance with vm_state deleted and task_state None.
Apr 14 12:20:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:20:45 user nova-compute[71330]: INFO nova.compute.claims [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Claim successful on node user
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.network.neutron [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:20:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:20:45 user nova-compute[71330]: INFO nova.virt.block_device [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Booting with volume 0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa at /dev/vda
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.policy [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG os_brick.utils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2714946-b77a-48d7-82cf-026bc9350d40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c13aa06-4f2e-4ef1-b05a-303eeeba9312]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa67300-d28a-4976-8d85-f16c64c82467]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fbdecc-395e-4198-b351-5a3015ae98f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:20:45 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:20:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a672ff72-48b9-4024-85e2-e36857bb51d9]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG os_brick.utils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:20:45 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Updating existing volume attachment record: fc8b8cbe-acd8-4f2a-96ca-c46d75ea945b {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:20:46 user nova-compute[71330]: DEBUG nova.network.neutron [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Successfully created port: c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Successfully updated port: c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquired lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received event network-changed-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Refreshing instance network info cache due to event network-changed-c53afdeb-2fc8-4aaf-bd49-0152c66bd222. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] Acquiring lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG nova.network.neutron [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Updating instance_info_cache with network_info: [{"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Releasing lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Instance network_info: |[{"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] Acquired lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:20:47 user nova-compute[71330]: DEBUG nova.network.neutron [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Refreshing network info cache for port c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:20:48 user nova-compute[71330]: DEBUG nova.network.neutron [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Updated VIF entry in instance network info cache for port c53afdeb-2fc8-4aaf-bd49-0152c66bd222. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:20:48 user nova-compute[71330]: DEBUG nova.network.neutron [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Updating instance_info_cache with network_info: [{"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:20:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] Releasing lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:20:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:20:50 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Creating image(s)
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Ensure instance console log exists: /opt/stack/data/nova/instances/d87d13b7-b18b-4645-bf3f-8f1afbc67b42/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Start _get_guest_xml network_info=[{"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'fc8b8cbe-acd8-4f2a-96ca-c46d75ea945b', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rthsjlMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd87d13b7-b18b-4645-bf3f-8f1afbc67b42', 'attached_at': '', 'detached_at': '', 'volume_id': '0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa', 'serial': '0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:20:50 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:20:50 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rthsjlMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:20:50 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:20:50 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:20:50 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[30db3b4f-3494-48fa-835a-094cda936f1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:20:50 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa79125c-9d13-44f0-a1ae-d57bab5b8f7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa] added
Apr 14 12:20:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2a4dca-5fa7-4e4e-93f0-3f28db51c9ad]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca01be92-8e60-4517-be21-d010576e331e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rthsjlMS {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rthsjlMS" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35767ac-c852-46e3-91c8-ca2202780162]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rthsjlMS'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[800d8dc7-ee4d-4f75-a98b-60f0d54d2695]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a898e-5d0a-4309-a758-e8fc5e66685d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:20:50 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:20:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:20:50 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:20:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c21ad8-497a-484b-9e2c-1fbcb44d15e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa, portal: 172.16.0.220,3260]
Apr 14 12:20:50 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa, portal: 172.16.0.220,3260] successful.
Apr 14 12:20:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7042089b-1496-47b4-acae-f532e1ea93d9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85f4000-5e48-4a79-89d0-6c254ad09022]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:20:50 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:20:50 user nova-compute[71330]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa (non-flash)
Apr 14 12:20:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:20:50 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:20:50 user nova-compute[71330]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa (non-flash)
Apr 14 12:20:50 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b213cff7-56ea-4fdf-a282-165c714dd5cc]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "95db2830-1af3-49e6-af4b-bb8805db707a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "95db2830-1af3-49e6-af4b-bb8805db707a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:50 user nova-compute[71330]: INFO nova.compute.manager [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Terminating instance
Apr 14 12:20:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:20:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received event network-vif-unplugged-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] Acquiring lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] No waiting events found dispatching network-vif-unplugged-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.compute.manager [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received event network-vif-unplugged-54a83467-5b88-4040-8edb-1bc984d9d179 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:20:51 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Instance destroyed successfully.
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.objects.instance [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lazy-loading 'resources' on Instance uuid 95db2830-1af3-49e6-af4b-bb8805db707a {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1643534439',display_name='tempest-VolumesActionsTest-instance-1643534439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1643534439',id=38,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:19:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9743d731274a493488bbf9df3d65d073',ramdisk_id='',reservation_id='r-dflyrx3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-993773268',owner_user_name='tempest-VolumesActionsTest-993773268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:19:07Z,user_data=None,user_id='e05e233f8bc749289056606d7046b38d',uuid=95db2830-1af3-49e6-af4b-bb8805db707a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converting VIF {"id": "54a83467-5b88-4040-8edb-1bc984d9d179", "address": "fa:16:3e:e5:7e:86", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a83467-5b", "ovs_interfaceid": "54a83467-5b88-4040-8edb-1bc984d9d179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=54a83467-5b88-4040-8edb-1bc984d9d179,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a83467-5b') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG os_vif [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=54a83467-5b88-4040-8edb-1bc984d9d179,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a83467-5b') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54a83467-5b, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:20:51 user nova-compute[71330]: INFO os_vif [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7e:86,bridge_name='br-int',has_traffic_filtering=True,id=54a83467-5b88-4040-8edb-1bc984d9d179,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a83467-5b')
Apr 14 12:20:51 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Deleting instance files /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a_del
Apr 14 12:20:51 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Deletion of /opt/stack/data/nova/instances/95db2830-1af3-49e6-af4b-bb8805db707a_del complete
Apr 14 12:20:51 user nova-compute[71330]: INFO nova.compute.manager [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 14 12:20:51 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rthsjlMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23861633564363035', 'path': '/dev/sdd'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861633564363035', 'path': '/dev/sdd'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1881127138',display_name='tempest-TestVolumeBootPattern-server-1881127138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1881127138',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA==',key_name='tempest-TestVolumeBootPattern-582531121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-zd36k33b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:20:46Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=d87d13b7-b18b-4645-bf3f-8f1afbc67b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=c53afdeb-2fc8-4aaf-bd49-0152c66bd222,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53afdeb-2f') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.objects.instance [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'pci_devices' on Instance uuid d87d13b7-b18b-4645-bf3f-8f1afbc67b42 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:20:51 user nova-compute[71330]:   <uuid>d87d13b7-b18b-4645-bf3f-8f1afbc67b42</uuid>
Apr 14 12:20:51 user nova-compute[71330]:   <name>instance-00000027</name>
Apr 14 12:20:51 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:20:51 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:20:51 user nova-compute[71330]:   <metadata>
Apr 14 12:20:51 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:20:51 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:20:51 user nova-compute[71330]:       <nova:name>tempest-TestVolumeBootPattern-server-1881127138</nova:name>
Apr 14 12:20:51 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:20:50</nova:creationTime>
Apr 14 12:20:51 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:20:51 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:20:51 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:20:51 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:20:51 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:20:51 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:20:51 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:20:51 user nova-compute[71330]:       <nova:owner>
Apr 14 12:20:51 user nova-compute[71330]:         <nova:user uuid="511fd95d993e4837a4a612385b04fdcb">tempest-TestVolumeBootPattern-2042813947-project-member</nova:user>
Apr 14 12:20:51 user nova-compute[71330]:         <nova:project uuid="0c317cb8d6a44115b216678540c433b6">tempest-TestVolumeBootPattern-2042813947</nova:project>
Apr 14 12:20:51 user nova-compute[71330]:       </nova:owner>
Apr 14 12:20:51 user nova-compute[71330]:       <nova:ports>
Apr 14 12:20:51 user nova-compute[71330]:         <nova:port uuid="c53afdeb-2fc8-4aaf-bd49-0152c66bd222">
Apr 14 12:20:51 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 12:20:51 user nova-compute[71330]:         </nova:port>
Apr 14 12:20:51 user nova-compute[71330]:       </nova:ports>
Apr 14 12:20:51 user nova-compute[71330]:     </nova:instance>
Apr 14 12:20:51 user nova-compute[71330]:   </metadata>
Apr 14 12:20:51 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:20:51 user nova-compute[71330]:     <system>
Apr 14 12:20:51 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:20:51 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:20:51 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:20:51 user nova-compute[71330]:       <entry name="serial">d87d13b7-b18b-4645-bf3f-8f1afbc67b42</entry>
Apr 14 12:20:51 user nova-compute[71330]:       <entry name="uuid">d87d13b7-b18b-4645-bf3f-8f1afbc67b42</entry>
Apr 14 12:20:51 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:20:51 user nova-compute[71330]:     </system>
Apr 14 12:20:51 user nova-compute[71330]:   </sysinfo>
Apr 14 12:20:51 user nova-compute[71330]:   <os>
Apr 14 12:20:51 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:20:51 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:20:51 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:20:51 user nova-compute[71330]:   </os>
Apr 14 12:20:51 user nova-compute[71330]:   <features>
Apr 14 12:20:51 user nova-compute[71330]:     <acpi/>
Apr 14 12:20:51 user nova-compute[71330]:     <apic/>
Apr 14 12:20:51 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:20:51 user nova-compute[71330]:   </features>
Apr 14 12:20:51 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:20:51 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:20:51 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:20:51 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:20:51 user nova-compute[71330]:   </clock>
Apr 14 12:20:51 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:20:51 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:20:51 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:20:51 user nova-compute[71330]:   </cpu>
Apr 14 12:20:51 user nova-compute[71330]:   <devices>
Apr 14 12:20:51 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:20:51 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:20:51 user nova-compute[71330]:       <source dev="/dev/sdd"/>
Apr 14 12:20:51 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:20:51 user nova-compute[71330]:       <serial>0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa</serial>
Apr 14 12:20:51 user nova-compute[71330]:     </disk>
Apr 14 12:20:51 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:20:51 user nova-compute[71330]:       <mac address="fa:16:3e:74:23:e3"/>
Apr 14 12:20:51 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:20:51 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:20:51 user nova-compute[71330]:       <target dev="tapc53afdeb-2f"/>
Apr 14 12:20:51 user nova-compute[71330]:     </interface>
Apr 14 12:20:51 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:20:51 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/d87d13b7-b18b-4645-bf3f-8f1afbc67b42/console.log" append="off"/>
Apr 14 12:20:51 user nova-compute[71330]:     </serial>
Apr 14 12:20:51 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:20:51 user nova-compute[71330]:     <video>
Apr 14 12:20:51 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:20:51 user nova-compute[71330]:     </video>
Apr 14 12:20:51 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:20:51 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:20:51 user nova-compute[71330]:     </rng>
Apr 14 12:20:51 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:20:51 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:20:51 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:20:51 user nova-compute[71330]:     </memballoon>
Apr 14 12:20:51 user nova-compute[71330]:   </devices>
Apr 14 12:20:51 user nova-compute[71330]: </domain>
Apr 14 12:20:51 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1881127138',display_name='tempest-TestVolumeBootPattern-server-1881127138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1881127138',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA==',key_name='tempest-TestVolumeBootPattern-582531121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-zd36k33b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:20:46Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=d87d13b7-b18b-4645-bf3f-8f1afbc67b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=c53afdeb-2fc8-4aaf-bd49-0152c66bd222,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53afdeb-2f') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG os_vif [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=c53afdeb-2fc8-4aaf-bd49-0152c66bd222,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53afdeb-2f') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc53afdeb-2f, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc53afdeb-2f, col_values=(('external_ids', {'iface-id': 'c53afdeb-2fc8-4aaf-bd49-0152c66bd222', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:23:e3', 'vm-uuid': 'd87d13b7-b18b-4645-bf3f-8f1afbc67b42'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:51 user nova-compute[71330]: INFO os_vif [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=c53afdeb-2fc8-4aaf-bd49-0152c66bd222,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53afdeb-2f')
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:20:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] No VIF found with MAC fa:16:3e:74:23:e3, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:20:52 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:20:52 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Took 0.58 seconds to deallocate network for instance.
Apr 14 12:20:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-b463f2f5-6b4e-4aae-a074-4228f638e804 req-c819133e-0b39-4457-b620-45bbf2464f4d service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received event network-vif-deleted-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:52 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:20:52 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:20:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:52 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Deleted allocations for instance 95db2830-1af3-49e6-af4b-bb8805db707a
Apr 14 12:20:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "95db2830-1af3-49e6-af4b-bb8805db707a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.749s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received event network-vif-plugged-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] Acquiring lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] Lock "95db2830-1af3-49e6-af4b-bb8805db707a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG nova.compute.manager [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] No waiting events found dispatching network-vif-plugged-54a83467-5b88-4040-8edb-1bc984d9d179 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:20:53 user nova-compute[71330]: WARNING nova.compute.manager [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Received unexpected event network-vif-plugged-54a83467-5b88-4040-8edb-1bc984d9d179 for instance with vm_state deleted and task_state None.
Apr 14 12:20:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:54 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474839.532877, 9741284c-15ce-41e3-934d-bf8f46a407f5 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:20:54 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] VM Stopped (Lifecycle Event)
Apr 14 12:20:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fcd5bb87-b954-4b6b-ba29-51329cc172ae None None] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474855.287534, d87d13b7-b18b-4645-bf3f-8f1afbc67b42 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:20:55 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] VM Resumed (Lifecycle Event)
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received event network-vif-plugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Acquiring lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] No waiting events found dispatching network-vif-plugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:20:55 user nova-compute[71330]: WARNING nova.compute.manager [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received unexpected event network-vif-plugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance with vm_state building and task_state spawning.
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received event network-vif-plugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Acquiring lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] No waiting events found dispatching network-vif-plugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:20:55 user nova-compute[71330]: WARNING nova.compute.manager [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received unexpected event network-vif-plugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance with vm_state building and task_state spawning.
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:20:55 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Instance spawned successfully.
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:20:55 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474855.288834, d87d13b7-b18b-4645-bf3f-8f1afbc67b42 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:20:55 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] VM Started (Lifecycle Event)
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:20:55 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:20:55 user nova-compute[71330]: INFO nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Took 4.96 seconds to spawn the instance on the hypervisor.
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:20:55 user nova-compute[71330]: INFO nova.compute.manager [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Took 10.34 seconds to build instance.
Apr 14 12:20:55 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.442s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 12:20:55 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:20:56 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:20:56 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:20:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:20:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:21:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:21:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:21:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:21:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:06 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474851.4661093, 95db2830-1af3-49e6-af4b-bb8805db707a => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:21:06 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] VM Stopped (Lifecycle Event)
Apr 14 12:21:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-e0f80131-29e8-426d-89d3-1852626da68d None None] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:21:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:07 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:21:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:07 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:21:08 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8228MB free_disk=26.259288787841797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Applying migration context for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 as it has an incoming, in-progress migration 4316685d-a85c-4df7-a749-74455fbc9778. Migration status is finished {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 12:21:08 user nova-compute[71330]: INFO nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating resource usage from migration 4316685d-a85c-4df7-a749-74455fbc9778
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e745394e-1cf2-40d8-a7ec-003677309895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 72e19f85-7f50-456a-a0af-b16e68471077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Migration 4316685d-a85c-4df7-a749-74455fbc9778 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:21:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:21:09 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:21:09 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:21:09 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:21:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:24 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Going to confirm migration 2 {{(pid=71330) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquired lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'info_cache' on Instance uuid 1324bca1-ccba-417a-ac3d-c1828a0de879 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG nova.network.neutron [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating instance_info_cache with network_info: [{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Releasing lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'migration_context' on Instance uuid 1324bca1-ccba-417a-ac3d-c1828a0de879 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:21:25 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:21:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.261s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:26 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Deleted allocation for migration 4316685d-a85c-4df7-a749-74455fbc9778
Apr 14 12:21:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.313s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:21:32 user nova-compute[71330]: INFO nova.compute.claims [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Claim successful on node user
Apr 14 12:21:32 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:21:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:21:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.policy [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:21:33 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Creating image(s)
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "/opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "/opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "/opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk 1073741824" returned: 0 in 0.052s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Cannot resize image /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.objects.instance [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'migration_context' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Ensure instance console log exists: /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Successfully created port: ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:21:34 user nova-compute[71330]: DEBUG nova.network.neutron [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Successfully updated port: ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:21:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "refresh_cache-4614224c-932d-4ab9-af71-5ee2b79c2868" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:21:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquired lock "refresh_cache-4614224c-932d-4ab9-af71-5ee2b79c2868" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:21:34 user nova-compute[71330]: DEBUG nova.network.neutron [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:21:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received event network-changed-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:21:34 user nova-compute[71330]: DEBUG nova.compute.manager [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Refreshing instance network info cache due to event network-changed-ed203286-06b3-4aa0-972f-5b3b85864e00. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:21:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] Acquiring lock "refresh_cache-4614224c-932d-4ab9-af71-5ee2b79c2868" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:21:34 user nova-compute[71330]: DEBUG nova.network.neutron [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.network.neutron [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Updating instance_info_cache with network_info: [{"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Releasing lock "refresh_cache-4614224c-932d-4ab9-af71-5ee2b79c2868" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Instance network_info: |[{"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] Acquired lock "refresh_cache-4614224c-932d-4ab9-af71-5ee2b79c2868" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.network.neutron [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Refreshing network info cache for port ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Start _get_guest_xml network_info=[{"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:21:35 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:21:35 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2146413711',display_name='tempest-AttachVolumeTestJSON-server-2146413711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2146413711',id=40,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB96+f0AatgHhQTr5ZIzP5ZL6VMvJr14C7rX7dyUdqDa2UfR0mbSC6G+D3OgiyapBaouDNuGoibx3vNl8NGrNsEkxu3grUfD65+47/2jjpoMwNkaENry5dTv4634Q31q8Q==',key_name='tempest-keypair-1624862949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-27d1hmmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=4614224c-932d-4ab9-af71-5ee2b79c2868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:93:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed203286-06b3-4aa0-972f-5b3b85864e00,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped203286-06') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.objects.instance [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'pci_devices' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:21:35 user nova-compute[71330]:   <uuid>4614224c-932d-4ab9-af71-5ee2b79c2868</uuid>
Apr 14 12:21:35 user nova-compute[71330]:   <name>instance-00000028</name>
Apr 14 12:21:35 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:21:35 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:21:35 user nova-compute[71330]:   <metadata>
Apr 14 12:21:35 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:21:35 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:21:35 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeTestJSON-server-2146413711</nova:name>
Apr 14 12:21:35 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:21:35</nova:creationTime>
Apr 14 12:21:35 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:21:35 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:21:35 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:21:35 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:21:35 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:21:35 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:21:35 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:21:35 user nova-compute[71330]:       <nova:owner>
Apr 14 12:21:35 user nova-compute[71330]:         <nova:user uuid="b7a65855384e4146a344cceb744e3e40">tempest-AttachVolumeTestJSON-341361172-project-member</nova:user>
Apr 14 12:21:35 user nova-compute[71330]:         <nova:project uuid="90ff3910da7c47e9828549306fda25d7">tempest-AttachVolumeTestJSON-341361172</nova:project>
Apr 14 12:21:35 user nova-compute[71330]:       </nova:owner>
Apr 14 12:21:35 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:21:35 user nova-compute[71330]:       <nova:ports>
Apr 14 12:21:35 user nova-compute[71330]:         <nova:port uuid="ed203286-06b3-4aa0-972f-5b3b85864e00">
Apr 14 12:21:35 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 12:21:35 user nova-compute[71330]:         </nova:port>
Apr 14 12:21:35 user nova-compute[71330]:       </nova:ports>
Apr 14 12:21:35 user nova-compute[71330]:     </nova:instance>
Apr 14 12:21:35 user nova-compute[71330]:   </metadata>
Apr 14 12:21:35 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:21:35 user nova-compute[71330]:     <system>
Apr 14 12:21:35 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:21:35 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:21:35 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:21:35 user nova-compute[71330]:       <entry name="serial">4614224c-932d-4ab9-af71-5ee2b79c2868</entry>
Apr 14 12:21:35 user nova-compute[71330]:       <entry name="uuid">4614224c-932d-4ab9-af71-5ee2b79c2868</entry>
Apr 14 12:21:35 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:21:35 user nova-compute[71330]:     </system>
Apr 14 12:21:35 user nova-compute[71330]:   </sysinfo>
Apr 14 12:21:35 user nova-compute[71330]:   <os>
Apr 14 12:21:35 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:21:35 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:21:35 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:21:35 user nova-compute[71330]:   </os>
Apr 14 12:21:35 user nova-compute[71330]:   <features>
Apr 14 12:21:35 user nova-compute[71330]:     <acpi/>
Apr 14 12:21:35 user nova-compute[71330]:     <apic/>
Apr 14 12:21:35 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:21:35 user nova-compute[71330]:   </features>
Apr 14 12:21:35 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:21:35 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:21:35 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:21:35 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:21:35 user nova-compute[71330]:   </clock>
Apr 14 12:21:35 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:21:35 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:21:35 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:21:35 user nova-compute[71330]:   </cpu>
Apr 14 12:21:35 user nova-compute[71330]:   <devices>
Apr 14 12:21:35 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:21:35 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:21:35 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk"/>
Apr 14 12:21:35 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:21:35 user nova-compute[71330]:     </disk>
Apr 14 12:21:35 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:21:35 user nova-compute[71330]:       <mac address="fa:16:3e:d8:93:e9"/>
Apr 14 12:21:35 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:21:35 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:21:35 user nova-compute[71330]:       <target dev="taped203286-06"/>
Apr 14 12:21:35 user nova-compute[71330]:     </interface>
Apr 14 12:21:35 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:21:35 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/console.log" append="off"/>
Apr 14 12:21:35 user nova-compute[71330]:     </serial>
Apr 14 12:21:35 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:21:35 user nova-compute[71330]:     <video>
Apr 14 12:21:35 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:21:35 user nova-compute[71330]:     </video>
Apr 14 12:21:35 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:21:35 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:21:35 user nova-compute[71330]:     </rng>
Apr 14 12:21:35 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:21:35 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:21:35 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:21:35 user nova-compute[71330]:     </memballoon>
Apr 14 12:21:35 user nova-compute[71330]:   </devices>
Apr 14 12:21:35 user nova-compute[71330]: </domain>
Apr 14 12:21:35 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2146413711',display_name='tempest-AttachVolumeTestJSON-server-2146413711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2146413711',id=40,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB96+f0AatgHhQTr5ZIzP5ZL6VMvJr14C7rX7dyUdqDa2UfR0mbSC6G+D3OgiyapBaouDNuGoibx3vNl8NGrNsEkxu3grUfD65+47/2jjpoMwNkaENry5dTv4634Q31q8Q==',key_name='tempest-keypair-1624862949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-27d1hmmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=4614224c-932d-4ab9-af71-5ee2b79c2868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:93:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed203286-06b3-4aa0-972f-5b3b85864e00,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped203286-06') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG os_vif [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:93:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed203286-06b3-4aa0-972f-5b3b85864e00,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped203286-06') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped203286-06, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped203286-06, col_values=(('external_ids', {'iface-id': 'ed203286-06b3-4aa0-972f-5b3b85864e00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:93:e9', 'vm-uuid': '4614224c-932d-4ab9-af71-5ee2b79c2868'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:35 user nova-compute[71330]: INFO os_vif [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:93:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed203286-06b3-4aa0-972f-5b3b85864e00,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped203286-06')
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No VIF found with MAC fa:16:3e:d8:93:e9, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.network.neutron [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Updated VIF entry in instance network info cache for port ed203286-06b3-4aa0-972f-5b3b85864e00. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG nova.network.neutron [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Updating instance_info_cache with network_info: [{"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:21:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] Releasing lock "refresh_cache-4614224c-932d-4ab9-af71-5ee2b79c2868" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:21:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received event network-vif-plugged-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:21:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] No waiting events found dispatching network-vif-plugged-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:21:37 user nova-compute[71330]: WARNING nova.compute.manager [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received unexpected event network-vif-plugged-ed203286-06b3-4aa0-972f-5b3b85864e00 for instance with vm_state building and task_state spawning.
Apr 14 12:21:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474899.0041268, 4614224c-932d-4ab9-af71-5ee2b79c2868 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:21:39 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] VM Resumed (Lifecycle Event)
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:21:39 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Instance spawned successfully.
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:39 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474899.0083392, 4614224c-932d-4ab9-af71-5ee2b79c2868 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:21:39 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] VM Started (Lifecycle Event)
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:21:39 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:21:39 user nova-compute[71330]: INFO nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Took 6.01 seconds to spawn the instance on the hypervisor.
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received event network-vif-plugged-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] No waiting events found dispatching network-vif-plugged-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:21:39 user nova-compute[71330]: WARNING nova.compute.manager [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received unexpected event network-vif-plugged-ed203286-06b3-4aa0-972f-5b3b85864e00 for instance with vm_state building and task_state spawning.
Apr 14 12:21:39 user nova-compute[71330]: INFO nova.compute.manager [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Took 6.64 seconds to build instance.
Apr 14 12:21:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.737s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "1c58eb62-6938-41e2-b1c7-603c81b8db61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:21:42 user nova-compute[71330]: INFO nova.compute.claims [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Claim successful on node user
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.network.neutron [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:21:42 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.policy [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e05e233f8bc749289056606d7046b38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9743d731274a493488bbf9df3d65d073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:21:42 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Creating image(s)
Apr 14 12:21:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "/opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "/opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.153s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.141s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk 1073741824" returned: 0 in 0.055s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.196s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Successfully created port: 66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Cannot resize image /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG nova.objects.instance [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lazy-loading 'migration_context' on Instance uuid 1c58eb62-6938-41e2-b1c7-603c81b8db61 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Ensure instance console log exists: /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Successfully updated port: 66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "refresh_cache-1c58eb62-6938-41e2-b1c7-603c81b8db61" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquired lock "refresh_cache-1c58eb62-6938-41e2-b1c7-603c81b8db61" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received event network-changed-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.compute.manager [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Refreshing instance network info cache due to event network-changed-66315514-390f-44a2-83ab-92b696400a9a. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] Acquiring lock "refresh_cache-1c58eb62-6938-41e2-b1c7-603c81b8db61" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.network.neutron [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Updating instance_info_cache with network_info: [{"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Releasing lock "refresh_cache-1c58eb62-6938-41e2-b1c7-603c81b8db61" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Instance network_info: |[{"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] Acquired lock "refresh_cache-1c58eb62-6938-41e2-b1c7-603c81b8db61" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.network.neutron [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Refreshing network info cache for port 66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Start _get_guest_xml network_info=[{"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:21:44 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:21:44 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:21:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2121882538',display_name='tempest-VolumesActionsTest-instance-2121882538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2121882538',id=41,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9743d731274a493488bbf9df3d65d073',ramdisk_id='',reservation_id='r-vjrjoqus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-993773268',owner_user_name='tempest-VolumesActionsTest-993773268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:21:43Z,user_data=None,user_id='e05e233f8bc749289056606d7046b38d',uuid=1c58eb62-6938-41e2-b1c7-603c81b8db61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converting VIF {"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:3e,bridge_name='br-int',has_traffic_filtering=True,id=66315514-390f-44a2-83ab-92b696400a9a,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66315514-39') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.objects.instance [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c58eb62-6938-41e2-b1c7-603c81b8db61 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:21:45 user nova-compute[71330]:   <uuid>1c58eb62-6938-41e2-b1c7-603c81b8db61</uuid>
Apr 14 12:21:45 user nova-compute[71330]:   <name>instance-00000029</name>
Apr 14 12:21:45 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:21:45 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:21:45 user nova-compute[71330]:   <metadata>
Apr 14 12:21:45 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:21:45 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:21:45 user nova-compute[71330]:       <nova:name>tempest-VolumesActionsTest-instance-2121882538</nova:name>
Apr 14 12:21:45 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:21:44</nova:creationTime>
Apr 14 12:21:45 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:21:45 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:21:45 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:21:45 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:21:45 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:21:45 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:21:45 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:21:45 user nova-compute[71330]:       <nova:owner>
Apr 14 12:21:45 user nova-compute[71330]:         <nova:user uuid="e05e233f8bc749289056606d7046b38d">tempest-VolumesActionsTest-993773268-project-member</nova:user>
Apr 14 12:21:45 user nova-compute[71330]:         <nova:project uuid="9743d731274a493488bbf9df3d65d073">tempest-VolumesActionsTest-993773268</nova:project>
Apr 14 12:21:45 user nova-compute[71330]:       </nova:owner>
Apr 14 12:21:45 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:21:45 user nova-compute[71330]:       <nova:ports>
Apr 14 12:21:45 user nova-compute[71330]:         <nova:port uuid="66315514-390f-44a2-83ab-92b696400a9a">
Apr 14 12:21:45 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 12:21:45 user nova-compute[71330]:         </nova:port>
Apr 14 12:21:45 user nova-compute[71330]:       </nova:ports>
Apr 14 12:21:45 user nova-compute[71330]:     </nova:instance>
Apr 14 12:21:45 user nova-compute[71330]:   </metadata>
Apr 14 12:21:45 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:21:45 user nova-compute[71330]:     <system>
Apr 14 12:21:45 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:21:45 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:21:45 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:21:45 user nova-compute[71330]:       <entry name="serial">1c58eb62-6938-41e2-b1c7-603c81b8db61</entry>
Apr 14 12:21:45 user nova-compute[71330]:       <entry name="uuid">1c58eb62-6938-41e2-b1c7-603c81b8db61</entry>
Apr 14 12:21:45 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:21:45 user nova-compute[71330]:     </system>
Apr 14 12:21:45 user nova-compute[71330]:   </sysinfo>
Apr 14 12:21:45 user nova-compute[71330]:   <os>
Apr 14 12:21:45 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:21:45 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:21:45 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:21:45 user nova-compute[71330]:   </os>
Apr 14 12:21:45 user nova-compute[71330]:   <features>
Apr 14 12:21:45 user nova-compute[71330]:     <acpi/>
Apr 14 12:21:45 user nova-compute[71330]:     <apic/>
Apr 14 12:21:45 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:21:45 user nova-compute[71330]:   </features>
Apr 14 12:21:45 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:21:45 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:21:45 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:21:45 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:21:45 user nova-compute[71330]:   </clock>
Apr 14 12:21:45 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:21:45 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:21:45 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:21:45 user nova-compute[71330]:   </cpu>
Apr 14 12:21:45 user nova-compute[71330]:   <devices>
Apr 14 12:21:45 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:21:45 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:21:45 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk"/>
Apr 14 12:21:45 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:21:45 user nova-compute[71330]:     </disk>
Apr 14 12:21:45 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:21:45 user nova-compute[71330]:       <mac address="fa:16:3e:fb:ef:3e"/>
Apr 14 12:21:45 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:21:45 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:21:45 user nova-compute[71330]:       <target dev="tap66315514-39"/>
Apr 14 12:21:45 user nova-compute[71330]:     </interface>
Apr 14 12:21:45 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:21:45 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/console.log" append="off"/>
Apr 14 12:21:45 user nova-compute[71330]:     </serial>
Apr 14 12:21:45 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:21:45 user nova-compute[71330]:     <video>
Apr 14 12:21:45 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:21:45 user nova-compute[71330]:     </video>
Apr 14 12:21:45 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:21:45 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:21:45 user nova-compute[71330]:     </rng>
Apr 14 12:21:45 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:21:45 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:21:45 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:21:45 user nova-compute[71330]:     </memballoon>
Apr 14 12:21:45 user nova-compute[71330]:   </devices>
Apr 14 12:21:45 user nova-compute[71330]: </domain>
Apr 14 12:21:45 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2121882538',display_name='tempest-VolumesActionsTest-instance-2121882538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2121882538',id=41,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9743d731274a493488bbf9df3d65d073',ramdisk_id='',reservation_id='r-vjrjoqus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-993773268',owner_user_name='tempest-VolumesActionsTest-993773268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:21:43Z,user_data=None,user_id='e05e233f8bc749289056606d7046b38d',uuid=1c58eb62-6938-41e2-b1c7-603c81b8db61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converting VIF {"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:3e,bridge_name='br-int',has_traffic_filtering=True,id=66315514-390f-44a2-83ab-92b696400a9a,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66315514-39') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG os_vif [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:3e,bridge_name='br-int',has_traffic_filtering=True,id=66315514-390f-44a2-83ab-92b696400a9a,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66315514-39') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66315514-39, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66315514-39, col_values=(('external_ids', {'iface-id': '66315514-390f-44a2-83ab-92b696400a9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:ef:3e', 'vm-uuid': '1c58eb62-6938-41e2-b1c7-603c81b8db61'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:45 user nova-compute[71330]: INFO os_vif [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:3e,bridge_name='br-int',has_traffic_filtering=True,id=66315514-390f-44a2-83ab-92b696400a9a,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66315514-39')
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] No VIF found with MAC fa:16:3e:fb:ef:3e, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.network.neutron [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Updated VIF entry in instance network info cache for port 66315514-390f-44a2-83ab-92b696400a9a. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG nova.network.neutron [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Updating instance_info_cache with network_info: [{"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:21:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] Releasing lock "refresh_cache-1c58eb62-6938-41e2-b1c7-603c81b8db61" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:21:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received event network-vif-plugged-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:21:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] Acquiring lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] No waiting events found dispatching network-vif-plugged-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:21:46 user nova-compute[71330]: WARNING nova.compute.manager [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received unexpected event network-vif-plugged-66315514-390f-44a2-83ab-92b696400a9a for instance with vm_state building and task_state spawning.
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474908.6835253, 1c58eb62-6938-41e2-b1c7-603c81b8db61 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:21:48 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] VM Resumed (Lifecycle Event)
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:21:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Instance spawned successfully.
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:21:48 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681474908.6857932, 1c58eb62-6938-41e2-b1c7-603c81b8db61 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:21:48 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] VM Started (Lifecycle Event)
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:21:48 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:21:48 user nova-compute[71330]: INFO nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Took 5.84 seconds to spawn the instance on the hypervisor.
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received event network-vif-plugged-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] Acquiring lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] No waiting events found dispatching network-vif-plugged-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:21:48 user nova-compute[71330]: WARNING nova.compute.manager [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received unexpected event network-vif-plugged-66315514-390f-44a2-83ab-92b696400a9a for instance with vm_state building and task_state spawning.
Apr 14 12:21:48 user nova-compute[71330]: INFO nova.compute.manager [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Took 6.51 seconds to build instance.
Apr 14 12:21:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.610s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:21:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:21:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:21:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:21:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:21:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid e745394e-1cf2-40d8-a7ec-003677309895 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Updating instance_info_cache with network_info: [{"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-e745394e-1cf2-40d8-a7ec-003677309895" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:21:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:58 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:21:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:21:59 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:22:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:22:01 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:22:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:22:08 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:22:08 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:22:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:22:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:22:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:22:08 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:22:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:08 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:10 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:22:10 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8004MB free_disk=26.21025848388672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e745394e-1cf2-40d8-a7ec-003677309895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 72e19f85-7f50-456a-a0af-b16e68471077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:22:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:22:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:22:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:22:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:22:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:22:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:22:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received event network-changed-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:22:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Refreshing instance network info cache due to event network-changed-c53afdeb-2fc8-4aaf-bd49-0152c66bd222. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:22:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] Acquiring lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:22:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] Acquired lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:22:37 user nova-compute[71330]: DEBUG nova.network.neutron [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Refreshing network info cache for port c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG nova.network.neutron [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Updated VIF entry in instance network info cache for port c53afdeb-2fc8-4aaf-bd49-0152c66bd222. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG nova.network.neutron [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Updating instance_info_cache with network_info: [{"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] Releasing lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:22:38 user nova-compute[71330]: INFO nova.compute.manager [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Terminating instance
Apr 14 12:22:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received event network-vif-unplugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] Acquiring lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] No waiting events found dispatching network-vif-unplugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:22:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received event network-vif-unplugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received event network-changed-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Refreshing instance network info cache due to event network-changed-c53afdeb-2fc8-4aaf-bd49-0152c66bd222. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] Acquiring lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] Acquired lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.network.neutron [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Refreshing network info cache for port c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:22:39 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Instance destroyed successfully.
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.objects.instance [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'resources' on Instance uuid d87d13b7-b18b-4645-bf3f-8f1afbc67b42 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1881127138',display_name='tempest-TestVolumeBootPattern-server-1881127138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1881127138',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA==',key_name='tempest-TestVolumeBootPattern-582531121',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:20:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-zd36k33b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:20:55Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=d87d13b7-b18b-4645-bf3f-8f1afbc67b42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=c53afdeb-2fc8-4aaf-bd49-0152c66bd222,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53afdeb-2f') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_vif [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=c53afdeb-2fc8-4aaf-bd49-0152c66bd222,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53afdeb-2f') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc53afdeb-2f, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:22:39 user nova-compute[71330]: INFO os_vif [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=c53afdeb-2fc8-4aaf-bd49-0152c66bd222,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53afdeb-2f')
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rthsjlMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:22:39 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f7302f-7b5f-41a3-aa6a-322221e29ed0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:22:39 user nova-compute[71330]: No targets found.
Apr 14 12:22:39 user nova-compute[71330]: iSNS:
Apr 14 12:22:39 user nova-compute[71330]: No targets found.
Apr 14 12:22:39 user nova-compute[71330]: STATIC:
Apr 14 12:22:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a
Apr 14 12:22:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:22:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:22:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28
Apr 14 12:22:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:22:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:22:39 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa
Apr 14 12:22:39 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:22:39 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:22:39 user nova-compute[71330]: FIRMWARE:
Apr 14 12:22:39 user nova-compute[71330]: No targets found.
Apr 14 12:22:39 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:22:39 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:22:39 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd582a-8ab6-469e-85f8-002f3e5663c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ecbadf-71fb-45d6-8325-56200c694c08]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:22:39 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:22:39 user nova-compute[71330]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa (non-flash)
Apr 14 12:22:39 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:22:39 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:22:39 user nova-compute[71330]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa (non-flash)
Apr 14 12:22:39 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495c217130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa'): ({'sdd'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Removing single pathed devices sdd {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a956f76-8ca1-4ed6-8312-c0354b1f62a6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[725965f1-e863-4cd6-be7c-c1469e004d10]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flushing IO for device /dev/sdd {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2794abb0-a700-4127-8c43-22c72ed21ca7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[39656bfc-e081-450e-95af-3513c4557c8b]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce4d132-d5b9-4193-9d24-c419f61fbdd6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[71220666-2341-4968-b782-27306916f949]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa, portal: 172.16.0.220,3260]
Apr 14 12:22:39 user nova-compute[71330]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa, portal: 172.16.0.220,3260] successful.
Apr 14 12:22:39 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.network.neutron [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Updated VIF entry in instance network info cache for port c53afdeb-2fc8-4aaf-bd49-0152c66bd222. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.network.neutron [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Updating instance_info_cache with network_info: [{"id": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "address": "fa:16:3e:74:23:e3", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53afdeb-2f", "ovs_interfaceid": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bb496a-906c-4035-96bd-c9604c303b40]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== disconnect_volume: return (325ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:22:39 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Deleting instance files /opt/stack/data/nova/instances/d87d13b7-b18b-4645-bf3f-8f1afbc67b42_del
Apr 14 12:22:39 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Deletion of /opt/stack/data/nova/instances/d87d13b7-b18b-4645-bf3f-8f1afbc67b42_del complete
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] Releasing lock "refresh_cache-d87d13b7-b18b-4645-bf3f-8f1afbc67b42" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:22:39 user nova-compute[71330]: INFO nova.compute.manager [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 14 12:22:39 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:22:39 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:22:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:40 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:22:40 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Took 0.52 seconds to deallocate network for instance.
Apr 14 12:22:40 user nova-compute[71330]: INFO nova.compute.manager [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Took 0.75 seconds to detach 1 volumes for instance.
Apr 14 12:22:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received event network-vif-plugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:22:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] Acquiring lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:22:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:22:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:22:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] No waiting events found dispatching network-vif-plugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:22:40 user nova-compute[71330]: WARNING nova.compute.manager [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received unexpected event network-vif-plugged-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance with vm_state active and task_state deleting.
Apr 14 12:22:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:22:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:22:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-61eb3f69-145f-4520-a57c-35e572273ead req-8c1a3c44-44ca-4df0-8c29-0e22499375af service nova] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Received event network-vif-deleted-c53afdeb-2fc8-4aaf-bd49-0152c66bd222 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:22:41 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:22:41 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:22:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:22:41 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Deleted allocations for instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42
Apr 14 12:22:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "d87d13b7-b18b-4645-bf3f-8f1afbc67b42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.849s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:22:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:22:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:22:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:22:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:22:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:54 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681474959.1690688, d87d13b7-b18b-4645-bf3f-8f1afbc67b42 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:22:54 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] VM Stopped (Lifecycle Event)
Apr 14 12:22:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-0aefad1d-f8a7-4e34-923b-232f21723e13 None None] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:22:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:22:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:22:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:22:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:22:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:22:57 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:22:58 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updating instance_info_cache with network_info: [{"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:22:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:22:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:22:58 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:22:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:23:02 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 12:23:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] There are 0 instances to clean {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 12:23:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:23:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:12 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:23:12 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8213MB free_disk=26.209129333496094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e745394e-1cf2-40d8-a7ec-003677309895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 72e19f85-7f50-456a-a0af-b16e68471077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing inventories for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating ProviderTree inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing aggregate associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, aggregates: None {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing trait associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:23:15 user nova-compute[71330]: INFO nova.compute.manager [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Get console output
Apr 14 12:23:16 user nova-compute[71330]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 12:23:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:23:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:23:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:23:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:23:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:19 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:19 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances with incomplete migration  {{(pid=71330) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 12:23:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:23 user nova-compute[71330]: DEBUG nova.compute.manager [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received event network-changed-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:23 user nova-compute[71330]: DEBUG nova.compute.manager [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Refreshing instance network info cache due to event network-changed-ed203286-06b3-4aa0-972f-5b3b85864e00. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:23:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] Acquiring lock "refresh_cache-4614224c-932d-4ab9-af71-5ee2b79c2868" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:23:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] Acquired lock "refresh_cache-4614224c-932d-4ab9-af71-5ee2b79c2868" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:23:23 user nova-compute[71330]: DEBUG nova.network.neutron [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Refreshing network info cache for port ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:23:24 user nova-compute[71330]: DEBUG nova.network.neutron [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Updated VIF entry in instance network info cache for port ed203286-06b3-4aa0-972f-5b3b85864e00. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:23:24 user nova-compute[71330]: DEBUG nova.network.neutron [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Updating instance_info_cache with network_info: [{"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:23:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] Releasing lock "refresh_cache-4614224c-932d-4ab9-af71-5ee2b79c2868" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:23:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:26 user nova-compute[71330]: INFO nova.compute.manager [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Attaching volume 5b39de44-631b-4fd2-b6ff-65371c884973 to /dev/vdb
Apr 14 12:23:26 user nova-compute[71330]: DEBUG os_brick.utils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8202109c-1074-4083-a3f1-8fbea15af593]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b937d-6da2-4f8f-bd4c-e361e37f60fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c774f2f-15ef-44a3-b8c8-37f2abe5195e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[761aa046-7fe3-4c92-b873-a98bbd612596]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:23:26 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:23:26 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea200e1-284e-4a98-a7fc-19684f4d1f34]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG os_brick.utils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:23:26 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Updating existing volume attachment record: 8a2efd9e-3640-4504-974d-0e0558f50eab {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:23:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXcDayQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:23:31 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:23:31 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:23:31 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6ac480-9968-4bd7-8b3f-71ef772081f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:23:31 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[66768abb-6544-465c-acec-d5cb4e41d520]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973] added
Apr 14 12:23:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff566f02-aca4-47ca-bee2-5da7a42b37d6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a15d23c-0371-400b-90ad-b0798cd745d9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXcDayQj {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXcDayQj" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2d6722-c13a-4b7e-8afd-c05ab65df08b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXcDayQj'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e5f667-c80a-45a0-9f80-fd03b826416d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5605af3e-2ad3-4f52-99bb-333def63f039]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:23:31 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:23:31 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcd76ab-ceaa-4133-a382-96839d9bf931]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973, portal: 172.16.0.220,3260]
Apr 14 12:23:31 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973, portal: 172.16.0.220,3260] successful.
Apr 14 12:23:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c856c086-f2cc-4d0e-9f46-05677757b007]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a92ff2-36ed-4f3a-ad1d-9db25bedd86c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:23:31 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:31 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:23:31 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:31 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:31 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[50744e06-3dcf-48fc-9b7e-f746d5f51492]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:23:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXcDayQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:23:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:23:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23363613137313761', 'path': '/dev/sdd'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:23:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363613137313761', 'path': '/dev/sdd'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:23:32 user nova-compute[71330]: DEBUG nova.objects.instance [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:23:32 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:23:32 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:23:32 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:23:32 user nova-compute[71330]:   <serial>5b39de44-631b-4fd2-b6ff-65371c884973</serial>
Apr 14 12:23:32 user nova-compute[71330]: </disk>
Apr 14 12:23:32 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:23:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:23:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:23:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No VIF found with MAC fa:16:3e:d8:93:e9, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:23:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.657s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "1c58eb62-6938-41e2-b1c7-603c81b8db61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:35 user nova-compute[71330]: INFO nova.compute.manager [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Terminating instance
Apr 14 12:23:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received event network-vif-unplugged-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] Acquiring lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] No waiting events found dispatching network-vif-unplugged-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:23:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received event network-vif-unplugged-66315514-390f-44a2-83ab-92b696400a9a for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:23:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Instance destroyed successfully.
Apr 14 12:23:36 user nova-compute[71330]: DEBUG nova.objects.instance [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lazy-loading 'resources' on Instance uuid 1c58eb62-6938-41e2-b1c7-603c81b8db61 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2121882538',display_name='tempest-VolumesActionsTest-instance-2121882538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2121882538',id=41,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:21:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9743d731274a493488bbf9df3d65d073',ramdisk_id='',reservation_id='r-vjrjoqus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-993773268',owner_user_name='tempest-VolumesActionsTest-993773268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:21:49Z,user_data=None,user_id='e05e233f8bc749289056606d7046b38d',uuid=1c58eb62-6938-41e2-b1c7-603c81b8db61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converting VIF {"id": "66315514-390f-44a2-83ab-92b696400a9a", "address": "fa:16:3e:fb:ef:3e", "network": {"id": "61b8bcf7-3906-43bf-a28f-4b184513279c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1350737815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9743d731274a493488bbf9df3d65d073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66315514-39", "ovs_interfaceid": "66315514-390f-44a2-83ab-92b696400a9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:3e,bridge_name='br-int',has_traffic_filtering=True,id=66315514-390f-44a2-83ab-92b696400a9a,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66315514-39') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG os_vif [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:3e,bridge_name='br-int',has_traffic_filtering=True,id=66315514-390f-44a2-83ab-92b696400a9a,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66315514-39') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66315514-39, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:23:36 user nova-compute[71330]: INFO os_vif [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:3e,bridge_name='br-int',has_traffic_filtering=True,id=66315514-390f-44a2-83ab-92b696400a9a,network=Network(61b8bcf7-3906-43bf-a28f-4b184513279c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66315514-39')
Apr 14 12:23:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Deleting instance files /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61_del
Apr 14 12:23:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Deletion of /opt/stack/data/nova/instances/1c58eb62-6938-41e2-b1c7-603c81b8db61_del complete
Apr 14 12:23:36 user nova-compute[71330]: INFO nova.compute.manager [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 12:23:36 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "e745394e-1cf2-40d8-a7ec-003677309895" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "e745394e-1cf2-40d8-a7ec-003677309895" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "e745394e-1cf2-40d8-a7ec-003677309895-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:36 user nova-compute[71330]: INFO nova.compute.manager [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Terminating instance
Apr 14 12:23:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.objects.instance [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received event network-vif-unplugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] Acquiring lock "e745394e-1cf2-40d8-a7ec-003677309895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] No waiting events found dispatching network-vif-unplugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received event network-vif-unplugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:37 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Took 0.95 seconds to deallocate network for instance.
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Instance destroyed successfully.
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.objects.instance [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lazy-loading 'resources' on Instance uuid e745394e-1cf2-40d8-a7ec-003677309895 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-988610230',display_name='tempest-ServersNegativeTestJSON-server-988610230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-988610230',id=32,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:14:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930c6e3aceb3445c8bed09847c92f271',ramdisk_id='',reservation_id='r-5kbh2w4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1103109288',owner_user_name='tempest-ServersNegativeTestJSON-1103109288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:14:57Z,user_data=None,user_id='f4063336b73e44ed991ca650d60bb3cd',uuid=e745394e-1cf2-40d8-a7ec-003677309895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converting VIF {"id": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "address": "fa:16:3e:93:d8:91", "network": {"id": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373619386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930c6e3aceb3445c8bed09847c92f271", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b8b30df-bc", "ovs_interfaceid": "4b8b30df-bc81-40b6-830e-c9846bb3b98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:d8:91,bridge_name='br-int',has_traffic_filtering=True,id=4b8b30df-bc81-40b6-830e-c9846bb3b98e,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b8b30df-bc') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG os_vif [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:d8:91,bridge_name='br-int',has_traffic_filtering=True,id=4b8b30df-bc81-40b6-830e-c9846bb3b98e,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b8b30df-bc') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b8b30df-bc, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:23:37 user nova-compute[71330]: INFO os_vif [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:d8:91,bridge_name='br-int',has_traffic_filtering=True,id=4b8b30df-bc81-40b6-830e-c9846bb3b98e,network=Network(42f6438c-9c79-4fe5-875b-1b5b5b9b0dda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b8b30df-bc')
Apr 14 12:23:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Deleting instance files /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895_del
Apr 14 12:23:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Deletion of /opt/stack/data/nova/instances/e745394e-1cf2-40d8-a7ec-003677309895_del complete
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:37 user nova-compute[71330]: INFO nova.compute.manager [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Attaching volume b2842569-143c-4da8-9bcf-1d531587d323 to /dev/vdc
Apr 14 12:23:37 user nova-compute[71330]: INFO nova.compute.manager [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: e745394e-1cf2-40d8-a7ec-003677309895] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG os_brick.utils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c311a4-05c4-4dfd-9104-df547c42f973]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b2dc35-d6ad-48fc-8078-c1e826c162b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e746ff8b-dac0-407d-b96a-59050bd2f825]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[446752e6-0daf-4218-9259-8eaced83380d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:23:37 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d8369-5dd6-421c-8eec-8ede0d6efeba]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG os_brick.utils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Updating existing volume attachment record: bc3dc1f7-f319-44c2-ace9-148416512944 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:37 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Deleted allocations for instance 1c58eb62-6938-41e2-b1c7-603c81b8db61
Apr 14 12:23:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.422s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:37 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:23:37 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Took 0.52 seconds to deallocate network for instance.
Apr 14 12:23:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received event network-vif-plugged-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Acquiring lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Lock "1c58eb62-6938-41e2-b1c7-603c81b8db61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] No waiting events found dispatching network-vif-plugged-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:23:38 user nova-compute[71330]: WARNING nova.compute.manager [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received unexpected event network-vif-plugged-66315514-390f-44a2-83ab-92b696400a9a for instance with vm_state deleted and task_state None.
Apr 14 12:23:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Received event network-vif-deleted-66315514-390f-44a2-83ab-92b696400a9a {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG nova.compute.manager [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received event network-vif-deleted-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:23:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:38 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Deleted allocations for instance e745394e-1cf2-40d8-a7ec-003677309895
Apr 14 12:23:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "e745394e-1cf2-40d8-a7ec-003677309895" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.967s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received event network-vif-plugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] Acquiring lock "e745394e-1cf2-40d8-a7ec-003677309895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] Lock "e745394e-1cf2-40d8-a7ec-003677309895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] No waiting events found dispatching network-vif-plugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:23:39 user nova-compute[71330]: WARNING nova.compute.manager [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Received unexpected event network-vif-plugged-4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance with vm_state deleted and task_state None.
Apr 14 12:23:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received event network-changed-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG nova.compute.manager [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Refreshing instance network info cache due to event network-changed-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] Acquiring lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] Acquired lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG nova.network.neutron [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Refreshing network info cache for port 16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "72e19f85-7f50-456a-a0af-b16e68471077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "72e19f85-7f50-456a-a0af-b16e68471077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "72e19f85-7f50-456a-a0af-b16e68471077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:39 user nova-compute[71330]: INFO nova.compute.manager [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Terminating instance
Apr 14 12:23:39 user nova-compute[71330]: DEBUG nova.compute.manager [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG nova.network.neutron [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updated VIF entry in instance network info cache for port 16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG nova.network.neutron [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updating instance_info_cache with network_info: [{"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:23:39 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] Releasing lock "refresh_cache-72e19f85-7f50-456a-a0af-b16e68471077" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:40 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Instance destroyed successfully.
Apr 14 12:23:40 user nova-compute[71330]: DEBUG nova.objects.instance [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lazy-loading 'resources' on Instance uuid 72e19f85-7f50-456a-a0af-b16e68471077 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1722857272',display_name='tempest-TestVolumeBootPattern-server-1722857272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1722857272',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA==',key_name='tempest-TestVolumeBootPattern-582531121',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:18:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c317cb8d6a44115b216678540c433b6',ramdisk_id='',reservation_id='r-pa01ccjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2042813947',owner_user_name='tempest-TestVolumeBootPattern-2042813947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:18:55Z,user_data=None,user_id='511fd95d993e4837a4a612385b04fdcb',uuid=72e19f85-7f50-456a-a0af-b16e68471077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converting VIF {"id": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "address": "fa:16:3e:20:a9:68", "network": {"id": "62954fef-bef3-483c-8311-33e968bc1180", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-51644731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c317cb8d6a44115b216678540c433b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c54e3f-13", "ovs_interfaceid": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c54e3f-13') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_vif [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c54e3f-13') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16c54e3f-13, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:23:40 user nova-compute[71330]: INFO os_vif [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e,network=Network(62954fef-bef3-483c-8311-33e968bc1180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c54e3f-13')
Apr 14 12:23:40 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKBsfQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:23:40 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4831b69-f6c6-44c2-9ba0-89484ee44da1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:23:40 user nova-compute[71330]: No targets found.
Apr 14 12:23:40 user nova-compute[71330]: iSNS:
Apr 14 12:23:40 user nova-compute[71330]: No targets found.
Apr 14 12:23:40 user nova-compute[71330]: STATIC:
Apr 14 12:23:40 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a
Apr 14 12:23:40 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:23:40 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:23:40 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28
Apr 14 12:23:40 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:23:40 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:23:40 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973
Apr 14 12:23:40 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:23:40 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:23:40 user nova-compute[71330]: FIRMWARE:
Apr 14 12:23:40 user nova-compute[71330]: No targets found.
Apr 14 12:23:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:23:40 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:23:40 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[268dadea-2762-4125-9c64-c1dd486ecdb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[04825d0c-2327-488b-8e2a-81de9997379d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:23:40 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:40 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a (non-flash)
Apr 14 12:23:40 user nova-compute[71330]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:40 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c22c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b912d45-bdd2-401d-861a-f92328c10b1f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6376ee0-0c64-47d7-93ac-2b3856b86c2d]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3451566-916d-4a3d-9b07-a558cb15a9a6]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[115b3f72-f8c7-43b7-9438-89421e457082]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1292b5a1', '/dev/disk/by-id/scsi-1SCST_BIO1292b5a1-93f9c2d39e000206', '/dev/disk/by-id/scsi-23933663963326433') {{(pid=82058) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[13588fcc-f871-439e-8a8c-cf355c31f1d0]: (4, None) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7f3827-60f4-43d0-90fb-6e8c95a59158]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[956703f1-a8fa-494e-91cd-dff8ce32d9ba]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260]
Apr 14 12:23:40 user nova-compute[71330]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a, portal: 172.16.0.220,3260] successful.
Apr 14 12:23:40 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c18af9-e524-4926-993c-10728f35875a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b023b5-d4b4-445b-8aa7-c76c9f3fb87d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] <== disconnect_volume: return (294ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:23:40 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Deleting instance files /opt/stack/data/nova/instances/72e19f85-7f50-456a-a0af-b16e68471077_del
Apr 14 12:23:40 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Deletion of /opt/stack/data/nova/instances/72e19f85-7f50-456a-a0af-b16e68471077_del complete
Apr 14 12:23:40 user nova-compute[71330]: INFO nova.compute.manager [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 14 12:23:40 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:23:40 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:23:41 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Took 0.47 seconds to deallocate network for instance.
Apr 14 12:23:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received event network-vif-deleted-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:41 user nova-compute[71330]: INFO nova.compute.manager [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Neutron deleted interface 16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e; detaching it from the instance and deleting it from the info cache
Apr 14 12:23:41 user nova-compute[71330]: DEBUG nova.network.neutron [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Detach interface failed, port_id=16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e, reason: Instance 72e19f85-7f50-456a-a0af-b16e68471077 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received event network-vif-unplugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Acquiring lock "72e19f85-7f50-456a-a0af-b16e68471077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] No waiting events found dispatching network-vif-unplugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received event network-vif-unplugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received event network-vif-plugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Acquiring lock "72e19f85-7f50-456a-a0af-b16e68471077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Lock "72e19f85-7f50-456a-a0af-b16e68471077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG nova.compute.manager [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] No waiting events found dispatching network-vif-plugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:23:41 user nova-compute[71330]: WARNING nova.compute.manager [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Received unexpected event network-vif-plugged-16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance with vm_state active and task_state deleting.
Apr 14 12:23:41 user nova-compute[71330]: INFO nova.compute.manager [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Took 0.76 seconds to detach 1 volumes for instance.
Apr 14 12:23:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:42 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Deleted allocations for instance 72e19f85-7f50-456a-a0af-b16e68471077
Apr 14 12:23:42 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYHEAKGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:23:42 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:23:42 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:23:42 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "72e19f85-7f50-456a-a0af-b16e68471077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.963s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb6b4b-aa1f-49b0-9ad0-6dd463eed29c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:23:42 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e41377a-7ced-4b67-940f-25f67ed3a8c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323] added
Apr 14 12:23:42 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff9e81-ee44-4470-986d-bc81438654f3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8806b793-8b19-417c-8f86-985f52019b86]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYHEAKGz {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYHEAKGz" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee713a6-b532-474e-b40d-463dea061083]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uYHEAKGz'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[765d0531-8193-45b0-b060-0b765c1b228d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ccc017-33c5-4e04-b8af-6d01568ae538]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8567fe2d-a63f-4f1a-9414-c0d05f54c5ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323, portal: 172.16.0.220,3260]
Apr 14 12:23:42 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323, portal: 172.16.0.220,3260] successful.
Apr 14 12:23:42 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe39a6-67c6-48ca-8bf9-e2f8048262c7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e748f55d-9651-4d4b-9d9a-c90f559503cc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 (non-flash)
Apr 14 12:23:42 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26383fd-a794-4761-a73a-770e669645a6]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:23:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYHEAKGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:23:43 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:23:43 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26264306564326138', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:23:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264306564326138', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:23:43 user nova-compute[71330]: DEBUG nova.objects.instance [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:23:43 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:23:43 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:23:43 user nova-compute[71330]:   <target dev="vdc" bus="virtio"/>
Apr 14 12:23:43 user nova-compute[71330]:   <serial>b2842569-143c-4da8-9bcf-1d531587d323</serial>
Apr 14 12:23:43 user nova-compute[71330]: </disk>
Apr 14 12:23:43 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:23:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:23:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:23:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:23:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] No VIF found with MAC fa:16:3e:d8:93:e9, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:23:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.733s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:45 user nova-compute[71330]: INFO nova.compute.manager [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Detaching volume 5b39de44-631b-4fd2-b6ff-65371c884973
Apr 14 12:23:45 user nova-compute[71330]: INFO nova.virt.block_device [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Attempting to driver detach volume 5b39de44-631b-4fd2-b6ff-65371c884973 from mountpoint /dev/vdb
Apr 14 12:23:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Attempting to detach device vdb from instance 4614224c-932d-4ab9-af71-5ee2b79c2868 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:23:45 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:23:45 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:23:45 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:23:45 user nova-compute[71330]:   <serial>5b39de44-631b-4fd2-b6ff-65371c884973</serial>
Apr 14 12:23:45 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:23:45 user nova-compute[71330]: </disk>
Apr 14 12:23:45 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:23:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully detached device vdb from instance 4614224c-932d-4ab9-af71-5ee2b79c2868 from the persistent domain config.
Apr 14 12:23:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4614224c-932d-4ab9-af71-5ee2b79c2868 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:23:45 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:23:45 user nova-compute[71330]:   <source dev="/dev/sdd"/>
Apr 14 12:23:45 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:23:45 user nova-compute[71330]:   <serial>5b39de44-631b-4fd2-b6ff-65371c884973</serial>
Apr 14 12:23:45 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:23:45 user nova-compute[71330]: </disk>
Apr 14 12:23:45 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681475025.8240075, 4614224c-932d-4ab9-af71-5ee2b79c2868 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:23:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully detached device vdb from instance 4614224c-932d-4ab9-af71-5ee2b79c2868 from the live domain config.
Apr 14 12:23:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXcDayQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:23:45 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2b019-9d4b-4793-ac79-88b2912e89a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:23:45 user nova-compute[71330]: No targets found.
Apr 14 12:23:45 user nova-compute[71330]: iSNS:
Apr 14 12:23:45 user nova-compute[71330]: No targets found.
Apr 14 12:23:45 user nova-compute[71330]: STATIC:
Apr 14 12:23:45 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28
Apr 14 12:23:45 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:23:45 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:23:45 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323
Apr 14 12:23:45 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:23:45 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:23:45 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973
Apr 14 12:23:45 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:23:45 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:23:45 user nova-compute[71330]: FIRMWARE:
Apr 14 12:23:45 user nova-compute[71330]: No targets found.
Apr 14 12:23:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:23:45 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:23:45 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6924bece-905f-4c78-b138-895be5e37444]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3260e20a-28e6-410e-8884-34450c233ec4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:45 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:45 user nova-compute[71330]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 (non-flash)
Apr 14 12:23:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:45 user nova-compute[71330]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 (non-flash)
Apr 14 12:23:45 user nova-compute[71330]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 (non-flash)
Apr 14 12:23:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4962b3e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973'): ({'sdd'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Removing single pathed devices sdd {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f64b6b-a269-4388-b97c-0751ad150aee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb518f7-c356-4adf-a3ed-799ac468e851]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flushing IO for device /dev/sdd {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9b83a0-ddd3-4130-914a-e525051b320b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:23:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[867716bf-10bc-4340-ab23-bfa6d3ff356a]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] SCSI volumes sdd have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc05ddd1-c5f7-492c-93c9-cebb9d2d7dc9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d92d12-6065-42bb-8fde-8eebd2b622c9]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973, portal: 172.16.0.220,3260]
Apr 14 12:23:46 user nova-compute[71330]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973, portal: 172.16.0.220,3260] successful.
Apr 14 12:23:46 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b39de44-631b-4fd2-b6ff-65371c884973 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5e7631-7e1b-45b5-9a7f-a717cf9306d2]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== disconnect_volume: return (315ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:47 user nova-compute[71330]: INFO nova.compute.manager [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Detaching volume b2842569-143c-4da8-9bcf-1d531587d323
Apr 14 12:23:47 user nova-compute[71330]: INFO nova.virt.block_device [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Attempting to driver detach volume b2842569-143c-4da8-9bcf-1d531587d323 from mountpoint /dev/vdc
Apr 14 12:23:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Attempting to detach device vdc from instance 4614224c-932d-4ab9-af71-5ee2b79c2868 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:23:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:23:47 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:23:47 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:23:47 user nova-compute[71330]:   <target dev="vdc" bus="virtio"/>
Apr 14 12:23:47 user nova-compute[71330]:   <serial>b2842569-143c-4da8-9bcf-1d531587d323</serial>
Apr 14 12:23:47 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 12:23:47 user nova-compute[71330]: </disk>
Apr 14 12:23:47 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:23:47 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully detached device vdc from instance 4614224c-932d-4ab9-af71-5ee2b79c2868 from the persistent domain config.
Apr 14 12:23:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4614224c-932d-4ab9-af71-5ee2b79c2868 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:23:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:23:47 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:23:47 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:23:47 user nova-compute[71330]:   <target dev="vdc" bus="virtio"/>
Apr 14 12:23:47 user nova-compute[71330]:   <serial>b2842569-143c-4da8-9bcf-1d531587d323</serial>
Apr 14 12:23:47 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 12:23:47 user nova-compute[71330]: </disk>
Apr 14 12:23:47 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681475028.1966598, 4614224c-932d-4ab9-af71-5ee2b79c2868 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:23:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully detached device vdc from instance 4614224c-932d-4ab9-af71-5ee2b79c2868 from the live domain config.
Apr 14 12:23:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYHEAKGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:23:48 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab0cee-399c-4f72-b79d-1a25ef1fdf29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:23:48 user nova-compute[71330]: No targets found.
Apr 14 12:23:48 user nova-compute[71330]: iSNS:
Apr 14 12:23:48 user nova-compute[71330]: No targets found.
Apr 14 12:23:48 user nova-compute[71330]: STATIC:
Apr 14 12:23:48 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28
Apr 14 12:23:48 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:23:48 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:23:48 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323
Apr 14 12:23:48 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:23:48 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:23:48 user nova-compute[71330]: FIRMWARE:
Apr 14 12:23:48 user nova-compute[71330]: No targets found.
Apr 14 12:23:48 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:23:48 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:23:48 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc125f5-4c47-459e-a3e8-17ca34cda2bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4774fad4-9210-46ce-a610-19e386b71944]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:48 user nova-compute[71330]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 (non-flash)
Apr 14 12:23:48 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:23:48 user nova-compute[71330]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 (non-flash)
Apr 14 12:23:48 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4918518550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83bfb50-4a38-4422-8cc2-490676bf9897]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c4d16c-a3f0-4651-b1d1-0bce64c0ab7b]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e884340-9889-4d9c-b0eb-df21abb3ce4b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[31436e67-57cf-454a-a32b-9b1fa830aab2]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e6c7b9-fade-4809-ab31-eb96b51e16dc]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9ddc60-8699-4ec2-82cf-37765a00d59b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323, portal: 172.16.0.220,3260]
Apr 14 12:23:48 user nova-compute[71330]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323, portal: 172.16.0.220,3260] successful.
Apr 14 12:23:48 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2842569-143c-4da8-9bcf-1d531587d323 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed9ec34-d145-44a0-b90f-d1feacf405c5]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] <== disconnect_volume: return (326ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:23:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:23:49 user nova-compute[71330]: DEBUG nova.objects.instance [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'flavor' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.637s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:50 user nova-compute[71330]: INFO nova.compute.manager [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Terminating instance
Apr 14 12:23:50 user nova-compute[71330]: DEBUG nova.compute.manager [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received event network-vif-unplugged-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] No waiting events found dispatching network-vif-unplugged-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:23:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received event network-vif-unplugged-ed203286-06b3-4aa0-972f-5b3b85864e00 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:23:51 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Instance destroyed successfully.
Apr 14 12:23:51 user nova-compute[71330]: DEBUG nova.objects.instance [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'resources' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2146413711',display_name='tempest-AttachVolumeTestJSON-server-2146413711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2146413711',id=40,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB96+f0AatgHhQTr5ZIzP5ZL6VMvJr14C7rX7dyUdqDa2UfR0mbSC6G+D3OgiyapBaouDNuGoibx3vNl8NGrNsEkxu3grUfD65+47/2jjpoMwNkaENry5dTv4634Q31q8Q==',key_name='tempest-keypair-1624862949',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90ff3910da7c47e9828549306fda25d7',ramdisk_id='',reservation_id='r-27d1hmmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-341361172',owner_user_name='tempest-AttachVolumeTestJSON-341361172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7a65855384e4146a344cceb744e3e40',uuid=4614224c-932d-4ab9-af71-5ee2b79c2868,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converting VIF {"id": "ed203286-06b3-4aa0-972f-5b3b85864e00", "address": "fa:16:3e:d8:93:e9", "network": {"id": "8f65a07f-a522-4aac-a358-42db7baf614d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-324254397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ff3910da7c47e9828549306fda25d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped203286-06", "ovs_interfaceid": "ed203286-06b3-4aa0-972f-5b3b85864e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:93:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed203286-06b3-4aa0-972f-5b3b85864e00,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped203286-06') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG os_vif [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:93:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed203286-06b3-4aa0-972f-5b3b85864e00,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped203286-06') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped203286-06, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:23:51 user nova-compute[71330]: INFO os_vif [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:93:e9,bridge_name='br-int',has_traffic_filtering=True,id=ed203286-06b3-4aa0-972f-5b3b85864e00,network=Network(8f65a07f-a522-4aac-a358-42db7baf614d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped203286-06')
Apr 14 12:23:51 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Deleting instance files /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868_del
Apr 14 12:23:51 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Deletion of /opt/stack/data/nova/instances/4614224c-932d-4ab9-af71-5ee2b79c2868_del complete
Apr 14 12:23:51 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475016.0998619, 1c58eb62-6938-41e2-b1c7-603c81b8db61 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:23:51 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] VM Stopped (Lifecycle Event)
Apr 14 12:23:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-03563eb0-65c9-4e6b-93f7-a177563d8579 None None] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:23:51 user nova-compute[71330]: INFO nova.compute.manager [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 12:23:51 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:23:51 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:23:51 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Took 0.84 seconds to deallocate network for instance.
Apr 14 12:23:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:52 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Deleted allocations for instance 4614224c-932d-4ab9-af71-5ee2b79c2868
Apr 14 12:23:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475017.3377073, e745394e-1cf2-40d8-a7ec-003677309895 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:23:52 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: e745394e-1cf2-40d8-a7ec-003677309895] VM Stopped (Lifecycle Event)
Apr 14 12:23:52 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b9c2d9f1-83a0-4889-80e2-ad84e6e55441 None None] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received event network-vif-plugged-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] Acquiring lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] Lock "4614224c-932d-4ab9-af71-5ee2b79c2868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] No waiting events found dispatching network-vif-plugged-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:23:52 user nova-compute[71330]: WARNING nova.compute.manager [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received unexpected event network-vif-plugged-ed203286-06b3-4aa0-972f-5b3b85864e00 for instance with vm_state deleted and task_state None.
Apr 14 12:23:52 user nova-compute[71330]: DEBUG nova.compute.manager [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Received event network-vif-deleted-ed203286-06b3-4aa0-972f-5b3b85864e00 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:23:54 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_power_states {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:23:54 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid 1324bca1-ccba-417a-ac3d-c1828a0de879 {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:23:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:23:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:23:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:54 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:23:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:55 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475020.1269, 72e19f85-7f50-456a-a0af-b16e68471077 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:23:55 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] VM Stopped (Lifecycle Event)
Apr 14 12:23:55 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b34713c0-47a2-41be-83ca-549b8b93ebed None None] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:23:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:23:56 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:57 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:23:57 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:23:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:23:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:23:57 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:23:58 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating instance_info_cache with network_info: [{"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:23:58 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-1324bca1-ccba-417a-ac3d-c1828a0de879" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:23:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:24:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:02 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:24:02 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:24:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:24:04 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:24:05 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:24:06 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475031.0266373, 4614224c-932d-4ab9-af71-5ee2b79c2868 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:24:06 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] VM Stopped (Lifecycle Event)
Apr 14 12:24:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-a7e01a6b-a24f-4289-a9f4-83a0802da3ad None None] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:24:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:24:11 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:24:11 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:24:11 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8513MB free_disk=26.264511108398438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=832MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:24:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:24:16 user nova-compute[71330]: INFO nova.compute.manager [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Terminating instance
Apr 14 12:24:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-unplugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] No waiting events found dispatching network-vif-unplugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-unplugged-95e757cd-56ba-460d-810a-2e9dd9d29919 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:17 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Instance destroyed successfully.
Apr 14 12:24:17 user nova-compute[71330]: DEBUG nova.objects.instance [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'resources' on Instance uuid 1324bca1-ccba-417a-ac3d-c1828a0de879 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-770192826',display_name='tempest-ServerActionsTestJSON-server-770192826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-770192826',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:19:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-0gru5rw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=1324bca1-ccba-417a-ac3d-c1828a0de879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "95e757cd-56ba-460d-810a-2e9dd9d29919", "address": "fa:16:3e:30:39:a0", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e757cd-56", "ovs_interfaceid": "95e757cd-56ba-460d-810a-2e9dd9d29919", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_vif [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95e757cd-56, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:17 user nova-compute[71330]: INFO os_vif [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:39:a0,bridge_name='br-int',has_traffic_filtering=True,id=95e757cd-56ba-460d-810a-2e9dd9d29919,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e757cd-56')
Apr 14 12:24:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruMcloJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:24:17 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6615b6-71bf-4058-a8bb-4ee66c9c5dc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:24:17 user nova-compute[71330]: No targets found.
Apr 14 12:24:17 user nova-compute[71330]: iSNS:
Apr 14 12:24:17 user nova-compute[71330]: No targets found.
Apr 14 12:24:17 user nova-compute[71330]: STATIC:
Apr 14 12:24:17 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28
Apr 14 12:24:17 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:24:17 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:24:17 user nova-compute[71330]: FIRMWARE:
Apr 14 12:24:17 user nova-compute[71330]: No targets found.
Apr 14 12:24:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:24:17 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:24:17 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab23fa8-2482-47f0-84ab-73f3fe7a4bf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2774b4fa-f985-4ab9-954b-267b38241d9d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:24:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 (non-flash)
Apr 14 12:24:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495c3e43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[25384611-0cb0-48f1-a3b9-6aa09d8717a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ca32ee-9cc6-4c16-ba28-90563856deef]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8d5fad-362f-453f-a6dd-f33a3f543f7c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c156fc-837d-42c0-a71e-493d52a7ed56]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a40e9950', '/dev/disk/by-id/scsi-26636653735333137', '/dev/disk/by-id/scsi-1SCST_BIOa40e9950-f6e7531737c82060') {{(pid=82058) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52b7375-8659-42cb-be93-795894a9ec8a]: (4, None) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1628894-7738-49d7-a16d-1aa977bd931d]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6cb97b-7f11-42f1-b285-7760b38a7c6a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260]
Apr 14 12:24:17 user nova-compute[71330]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28, portal: 172.16.0.220,3260] successful.
Apr 14 12:24:17 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c761194-9415-479b-82d2-23b11346cb28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[269f2a33-5dee-4a04-affc-afa809df4fa9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] <== disconnect_volume: return (288ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:24:17 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Deleting instance files /opt/stack/data/nova/instances/1324bca1-ccba-417a-ac3d-c1828a0de879_del
Apr 14 12:24:17 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Deletion of /opt/stack/data/nova/instances/1324bca1-ccba-417a-ac3d-c1828a0de879_del complete
Apr 14 12:24:17 user nova-compute[71330]: INFO nova.compute.manager [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Took 1.11 seconds to destroy the instance on the hypervisor.
Apr 14 12:24:17 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:24:17 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:24:18 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:24:18 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Took 0.85 seconds to deallocate network for instance.
Apr 14 12:24:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:24:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] Acquiring lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:24:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:24:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:24:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] No waiting events found dispatching network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:24:18 user nova-compute[71330]: WARNING nova.compute.manager [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received unexpected event network-vif-plugged-95e757cd-56ba-460d-810a-2e9dd9d29919 for instance with vm_state active and task_state deleting.
Apr 14 12:24:18 user nova-compute[71330]: DEBUG nova.compute.manager [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Received event network-vif-deleted-95e757cd-56ba-460d-810a-2e9dd9d29919 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:24:19 user nova-compute[71330]: INFO nova.compute.manager [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 12:24:19 user nova-compute[71330]: DEBUG nova.compute.manager [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Deleting volume: 9c761194-9415-479b-82d2-23b11346cb28 {{(pid=71330) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 12:24:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:24:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:24:19 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:24:19 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:24:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:24:19 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Deleted allocations for instance 1324bca1-ccba-417a-ac3d-c1828a0de879
Apr 14 12:24:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "1324bca1-ccba-417a-ac3d-c1828a0de879" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.192s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:24:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:24:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:32 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475057.3501084, 1324bca1-ccba-417a-ac3d-c1828a0de879 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:24:32 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] VM Stopped (Lifecycle Event)
Apr 14 12:24:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-ac2c39ab-52fd-41e6-a457-753951dcdac9 None None] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:24:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:24:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:24:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:24:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:24:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:24:52 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:24:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:57 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:24:58 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:24:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:24:58 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 12:24:58 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:02 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:02 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:25:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:05 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:07 user nova-compute[71330]: INFO nova.compute.manager [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Terminating instance
Apr 14 12:25:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received event network-vif-unplugged-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] Acquiring lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] No waiting events found dispatching network-vif-unplugged-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:25:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received event network-vif-unplugged-04e58506-8191-400e-9aa7-bd8ffc6293ee for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:25:08 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Instance destroyed successfully.
Apr 14 12:25:08 user nova-compute[71330]: DEBUG nova.objects.instance [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'resources' on Instance uuid 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1318615277',display_name='tempest-ServerActionsTestJSON-server-1318615277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1318615277',id=33,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g==',key_name='tempest-keypair-2086314618',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:15:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e4ff63247dd4535bcd86acfde76fd34',ramdisk_id='',reservation_id='r-6irb6wr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1592133549',owner_user_name='tempest-ServerActionsTestJSON-1592133549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:15:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e264a59ff9b42e08095d0ce71e4d627',uuid=88ea9bf2-f5e5-4629-a6e8-55a3ef69c654,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converting VIF {"id": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "address": "fa:16:3e:07:1a:61", "network": {"id": "12b17cd5-254d-41fb-b300-9968f8c873ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-488843070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e4ff63247dd4535bcd86acfde76fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e58506-81", "ovs_interfaceid": "04e58506-8191-400e-9aa7-bd8ffc6293ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:1a:61,bridge_name='br-int',has_traffic_filtering=True,id=04e58506-8191-400e-9aa7-bd8ffc6293ee,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e58506-81') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG os_vif [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:1a:61,bridge_name='br-int',has_traffic_filtering=True,id=04e58506-8191-400e-9aa7-bd8ffc6293ee,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e58506-81') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04e58506-81, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:25:08 user nova-compute[71330]: INFO os_vif [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:1a:61,bridge_name='br-int',has_traffic_filtering=True,id=04e58506-8191-400e-9aa7-bd8ffc6293ee,network=Network(12b17cd5-254d-41fb-b300-9968f8c873ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e58506-81')
Apr 14 12:25:08 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Deleting instance files /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654_del
Apr 14 12:25:08 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Deletion of /opt/stack/data/nova/instances/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654_del complete
Apr 14 12:25:08 user nova-compute[71330]: INFO nova.compute.manager [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 14 12:25:08 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:25:08 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Took 0.50 seconds to deallocate network for instance.
Apr 14 12:25:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:25:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:08 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Deleted allocations for instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654
Apr 14 12:25:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.767s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received event network-vif-plugged-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:25:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] Acquiring lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] Lock "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] No waiting events found dispatching network-vif-plugged-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:25:09 user nova-compute[71330]: WARNING nova.compute.manager [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received unexpected event network-vif-plugged-04e58506-8191-400e-9aa7-bd8ffc6293ee for instance with vm_state deleted and task_state None.
Apr 14 12:25:09 user nova-compute[71330]: DEBUG nova.compute.manager [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Received event network-vif-deleted-04e58506-8191-400e-9aa7-bd8ffc6293ee {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:25:10 user nova-compute[71330]: INFO nova.compute.claims [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Claim successful on node user
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:25:10 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.policy [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:25:10 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Creating image(s)
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "/opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "/opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:10 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk 1073741824" returned: 0 in 0.073s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.161s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Cannot resize image /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'migration_context' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Ensure instance console log exists: /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Successfully created port: 9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:11 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:25:12 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:25:12 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8669MB free_disk=26.269855499267578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Successfully updated port: 9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquired lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received event network-changed-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Refreshing instance network info cache due to event network-changed-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] Acquiring lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.network.neutron [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updating instance_info_cache with network_info: [{"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Releasing lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Instance network_info: |[{"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] Acquired lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.network.neutron [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Refreshing network info cache for port 9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Start _get_guest_xml network_info=[{"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:25:12 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:25:12 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1762137749',display_name='tempest-AttachVolumeNegativeTest-server-1762137749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1762137749',id=42,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8ZqjJNlf6FcYJIsVPd5Dq8NarYmFZ3EAxa4FpVKDQXSqboh3ngEuQm+3/ETqlNE/NPRoxD1k/GMhVZVbSixZx64hLBNYP8cF904WSQYGVXi3AQ5hvMZKO37FrgHGj9HQ==',key_name='tempest-keypair-1947744203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-nj7qq444',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=e4c20f68-5164-4e7e-b699-5d0ad9bd3141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5d:93,bridge_name='br-int',has_traffic_filtering=True,id=9759ea45-36a6-4d4d-b74e-cb8731fbdcd7,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ea45-36') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'pci_devices' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:25:12 user nova-compute[71330]:   <uuid>e4c20f68-5164-4e7e-b699-5d0ad9bd3141</uuid>
Apr 14 12:25:12 user nova-compute[71330]:   <name>instance-0000002a</name>
Apr 14 12:25:12 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:25:12 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:25:12 user nova-compute[71330]:   <metadata>
Apr 14 12:25:12 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:25:12 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:25:12 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1762137749</nova:name>
Apr 14 12:25:12 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:25:12</nova:creationTime>
Apr 14 12:25:12 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:25:12 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:25:12 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:25:12 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:25:12 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:25:12 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:25:12 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:25:12 user nova-compute[71330]:       <nova:owner>
Apr 14 12:25:12 user nova-compute[71330]:         <nova:user uuid="609f2fce20c44000903c8a05e07ebd67">tempest-AttachVolumeNegativeTest-1138909145-project-member</nova:user>
Apr 14 12:25:12 user nova-compute[71330]:         <nova:project uuid="fa90860f65ab408aa00dfd6abb8af18b">tempest-AttachVolumeNegativeTest-1138909145</nova:project>
Apr 14 12:25:12 user nova-compute[71330]:       </nova:owner>
Apr 14 12:25:12 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:25:12 user nova-compute[71330]:       <nova:ports>
Apr 14 12:25:12 user nova-compute[71330]:         <nova:port uuid="9759ea45-36a6-4d4d-b74e-cb8731fbdcd7">
Apr 14 12:25:12 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 12:25:12 user nova-compute[71330]:         </nova:port>
Apr 14 12:25:12 user nova-compute[71330]:       </nova:ports>
Apr 14 12:25:12 user nova-compute[71330]:     </nova:instance>
Apr 14 12:25:12 user nova-compute[71330]:   </metadata>
Apr 14 12:25:12 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:25:12 user nova-compute[71330]:     <system>
Apr 14 12:25:12 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:25:12 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:25:12 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:25:12 user nova-compute[71330]:       <entry name="serial">e4c20f68-5164-4e7e-b699-5d0ad9bd3141</entry>
Apr 14 12:25:12 user nova-compute[71330]:       <entry name="uuid">e4c20f68-5164-4e7e-b699-5d0ad9bd3141</entry>
Apr 14 12:25:12 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:25:12 user nova-compute[71330]:     </system>
Apr 14 12:25:12 user nova-compute[71330]:   </sysinfo>
Apr 14 12:25:12 user nova-compute[71330]:   <os>
Apr 14 12:25:12 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:25:12 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:25:12 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:25:12 user nova-compute[71330]:   </os>
Apr 14 12:25:12 user nova-compute[71330]:   <features>
Apr 14 12:25:12 user nova-compute[71330]:     <acpi/>
Apr 14 12:25:12 user nova-compute[71330]:     <apic/>
Apr 14 12:25:12 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:25:12 user nova-compute[71330]:   </features>
Apr 14 12:25:12 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:25:12 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:25:12 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:25:12 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:25:12 user nova-compute[71330]:   </clock>
Apr 14 12:25:12 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:25:12 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:25:12 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:25:12 user nova-compute[71330]:   </cpu>
Apr 14 12:25:12 user nova-compute[71330]:   <devices>
Apr 14 12:25:12 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:25:12 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:25:12 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk"/>
Apr 14 12:25:12 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:25:12 user nova-compute[71330]:     </disk>
Apr 14 12:25:12 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:25:12 user nova-compute[71330]:       <mac address="fa:16:3e:d8:5d:93"/>
Apr 14 12:25:12 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:25:12 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:25:12 user nova-compute[71330]:       <target dev="tap9759ea45-36"/>
Apr 14 12:25:12 user nova-compute[71330]:     </interface>
Apr 14 12:25:12 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:25:12 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/console.log" append="off"/>
Apr 14 12:25:12 user nova-compute[71330]:     </serial>
Apr 14 12:25:12 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:25:12 user nova-compute[71330]:     <video>
Apr 14 12:25:12 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:25:12 user nova-compute[71330]:     </video>
Apr 14 12:25:12 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:25:12 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:25:12 user nova-compute[71330]:     </rng>
Apr 14 12:25:12 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:25:12 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:25:12 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:25:12 user nova-compute[71330]:     </memballoon>
Apr 14 12:25:12 user nova-compute[71330]:   </devices>
Apr 14 12:25:12 user nova-compute[71330]: </domain>
Apr 14 12:25:12 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1762137749',display_name='tempest-AttachVolumeNegativeTest-server-1762137749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1762137749',id=42,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8ZqjJNlf6FcYJIsVPd5Dq8NarYmFZ3EAxa4FpVKDQXSqboh3ngEuQm+3/ETqlNE/NPRoxD1k/GMhVZVbSixZx64hLBNYP8cF904WSQYGVXi3AQ5hvMZKO37FrgHGj9HQ==',key_name='tempest-keypair-1947744203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-nj7qq444',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=e4c20f68-5164-4e7e-b699-5d0ad9bd3141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5d:93,bridge_name='br-int',has_traffic_filtering=True,id=9759ea45-36a6-4d4d-b74e-cb8731fbdcd7,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ea45-36') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG os_vif [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5d:93,bridge_name='br-int',has_traffic_filtering=True,id=9759ea45-36a6-4d4d-b74e-cb8731fbdcd7,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ea45-36') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9759ea45-36, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9759ea45-36, col_values=(('external_ids', {'iface-id': '9759ea45-36a6-4d4d-b74e-cb8731fbdcd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:5d:93', 'vm-uuid': 'e4c20f68-5164-4e7e-b699-5d0ad9bd3141'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:12 user nova-compute[71330]: INFO os_vif [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5d:93,bridge_name='br-int',has_traffic_filtering=True,id=9759ea45-36a6-4d4d-b74e-cb8731fbdcd7,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ea45-36')
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:25:12 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No VIF found with MAC fa:16:3e:d8:5d:93, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:25:13 user nova-compute[71330]: DEBUG nova.network.neutron [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updated VIF entry in instance network info cache for port 9759ea45-36a6-4d4d-b74e-cb8731fbdcd7. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:25:13 user nova-compute[71330]: DEBUG nova.network.neutron [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updating instance_info_cache with network_info: [{"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:25:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] Releasing lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:25:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received event network-vif-plugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:25:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] No waiting events found dispatching network-vif-plugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:25:14 user nova-compute[71330]: WARNING nova.compute.manager [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received unexpected event network-vif-plugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance with vm_state building and task_state spawning.
Apr 14 12:25:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475116.637231, e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:25:16 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] VM Resumed (Lifecycle Event)
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:25:16 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Instance spawned successfully.
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received event network-vif-plugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.compute.manager [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] No waiting events found dispatching network-vif-plugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:25:16 user nova-compute[71330]: WARNING nova.compute.manager [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received unexpected event network-vif-plugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance with vm_state building and task_state spawning.
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:25:16 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475116.6419096, e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:25:16 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] VM Started (Lifecycle Event)
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:25:16 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:25:16 user nova-compute[71330]: INFO nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Took 6.07 seconds to spawn the instance on the hypervisor.
Apr 14 12:25:16 user nova-compute[71330]: DEBUG nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:25:16 user nova-compute[71330]: INFO nova.compute.manager [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Took 6.64 seconds to build instance.
Apr 14 12:25:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.758s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:23 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475108.0786748, 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:25:23 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] VM Stopped (Lifecycle Event)
Apr 14 12:25:23 user nova-compute[71330]: DEBUG nova.compute.manager [None req-437d064e-1918-4a94-ab22-4c48988707c5 None None] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:25:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:32 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:37 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:25:38 user nova-compute[71330]: INFO nova.compute.claims [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Claim successful on node user
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.network.neutron [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:25:38 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.policy [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0dcf77e350494142983fef3fd95ec080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429cce7d6b244be8ba4f0ed36ed98863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:25:38 user nova-compute[71330]: INFO nova.virt.block_device [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Booting with volume bac8fa14-5f8b-4159-ba79-b5b0fa473d99 at /dev/vda
Apr 14 12:25:38 user nova-compute[71330]: DEBUG os_brick.utils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[397150eb-7124-4d22-a26e-8d6baa0f3c9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e701e0a4-ca1c-42d0-99d8-1b905c124b03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f15c90-ac1c-4854-9eab-8662c4f983fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8ed42e-2def-4b67-992a-6c1d176ad589]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:25:38 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:25:38 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8f3eef-dbfd-4e8a-9368-df0b567cff35]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG os_brick.utils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:25:38 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating existing volume attachment record: e59771dd-131a-4bed-9ab2-ec55706304fd {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:25:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:39 user nova-compute[71330]: DEBUG nova.network.neutron [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Successfully created port: 8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.network.neutron [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Successfully updated port: 8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.network.neutron [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.compute.manager [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing instance network info cache due to event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.network.neutron [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.network.neutron [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Instance network_info: |[{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.network.neutron [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.network.neutron [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updated VIF entry in instance network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:25:40 user nova-compute[71330]: DEBUG nova.network.neutron [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:25:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:25:42 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:25:43 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Creating image(s)
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Ensure instance console log exists: /opt/stack/data/nova/instances/22d88480-665d-4d11-b22f-998d58ed25f4/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Start _get_guest_xml network_info=[{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'e59771dd-131a-4bed-9ab2-ec55706304fd', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqvjNBWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22d88480-665d-4d11-b22f-998d58ed25f4', 'attached_at': '', 'detached_at': '', 'volume_id': 'bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'serial': 'bac8fa14-5f8b-4159-ba79-b5b0fa473d99'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:25:43 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:25:43 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqvjNBWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:25:43 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:25:43 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:25:43 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:25:43 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:25:43 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:25:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16159a9-6e8e-4a7f-bba7-42578157841e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:25:43 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:25:43 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a734397-cb7c-4c4a-8064-3c6ae47777a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99] added
Apr 14 12:25:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d470a-2f09-48c7-86dd-1b746060888a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f6dda-a0f2-47f6-8549-c83f1aeb6002]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqvjNBWm {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqvjNBWm" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb974c-5211-4a76-bb48-4403fc7125a9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KqvjNBWm'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e1a55b-9c62-4bd8-80ae-c1d029736c27]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3569ee5e-420c-4359-a467-a986f49fc216]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 12:25:44 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 12:25:44 user nova-compute[71330]:  {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:25:44 user nova-compute[71330]: WARNING os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 12:25:44 user nova-compute[71330]: 
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e87165b-a08a-4460-a52d-17d19972e7a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260]
Apr 14 12:25:44 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260] successful.
Apr 14 12:25:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72e92cb-7c8e-45cb-9a42-9bba9ccc256f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2e1d7c-649a-440e-ad6e-7e716d1252dc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:25:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:25:44 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[316f4225-0cfa-4c8b-94e2-c7567b24fa9f]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:25:44 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqvjNBWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23935363566343262', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935363566343262', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-660218859',display_name='tempest-TestShelveInstance-server-660218859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-660218859',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx73a5JRZ+Vcnm3BGIc9YGjGbFiNtAVL0mP06rY5GWLceZGaxSWT/qv0+RiU/G63lqlXep5Kc8i43AWTDBaUZb85XVPXi9LqBIdLi6RC3Ta56TQn5rmkT5zYjxJkAwSXw==',key_name='tempest-TestShelveInstance-53342841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='429cce7d6b244be8ba4f0ed36ed98863',ramdisk_id='',reservation_id='r-4z05b0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1593326624',owner_user_name='tempest-TestShelveInstance-1593326624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:25:38Z,user_data=None,user_id='0dcf77e350494142983fef3fd95ec080',uuid=22d88480-665d-4d11-b22f-998d58ed25f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converting VIF {"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.objects.instance [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lazy-loading 'pci_devices' on Instance uuid 22d88480-665d-4d11-b22f-998d58ed25f4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:25:45 user nova-compute[71330]:   <uuid>22d88480-665d-4d11-b22f-998d58ed25f4</uuid>
Apr 14 12:25:45 user nova-compute[71330]:   <name>instance-0000002b</name>
Apr 14 12:25:45 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:25:45 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:25:45 user nova-compute[71330]:   <metadata>
Apr 14 12:25:45 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:25:45 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:25:45 user nova-compute[71330]:       <nova:name>tempest-TestShelveInstance-server-660218859</nova:name>
Apr 14 12:25:45 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:25:43</nova:creationTime>
Apr 14 12:25:45 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:25:45 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:25:45 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:25:45 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:25:45 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:25:45 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:25:45 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:25:45 user nova-compute[71330]:       <nova:owner>
Apr 14 12:25:45 user nova-compute[71330]:         <nova:user uuid="0dcf77e350494142983fef3fd95ec080">tempest-TestShelveInstance-1593326624-project-member</nova:user>
Apr 14 12:25:45 user nova-compute[71330]:         <nova:project uuid="429cce7d6b244be8ba4f0ed36ed98863">tempest-TestShelveInstance-1593326624</nova:project>
Apr 14 12:25:45 user nova-compute[71330]:       </nova:owner>
Apr 14 12:25:45 user nova-compute[71330]:       <nova:ports>
Apr 14 12:25:45 user nova-compute[71330]:         <nova:port uuid="8b52e74d-0e38-439d-8857-f07336dea29c">
Apr 14 12:25:45 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 12:25:45 user nova-compute[71330]:         </nova:port>
Apr 14 12:25:45 user nova-compute[71330]:       </nova:ports>
Apr 14 12:25:45 user nova-compute[71330]:     </nova:instance>
Apr 14 12:25:45 user nova-compute[71330]:   </metadata>
Apr 14 12:25:45 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:25:45 user nova-compute[71330]:     <system>
Apr 14 12:25:45 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:25:45 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:25:45 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:25:45 user nova-compute[71330]:       <entry name="serial">22d88480-665d-4d11-b22f-998d58ed25f4</entry>
Apr 14 12:25:45 user nova-compute[71330]:       <entry name="uuid">22d88480-665d-4d11-b22f-998d58ed25f4</entry>
Apr 14 12:25:45 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:25:45 user nova-compute[71330]:     </system>
Apr 14 12:25:45 user nova-compute[71330]:   </sysinfo>
Apr 14 12:25:45 user nova-compute[71330]:   <os>
Apr 14 12:25:45 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:25:45 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:25:45 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:25:45 user nova-compute[71330]:   </os>
Apr 14 12:25:45 user nova-compute[71330]:   <features>
Apr 14 12:25:45 user nova-compute[71330]:     <acpi/>
Apr 14 12:25:45 user nova-compute[71330]:     <apic/>
Apr 14 12:25:45 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:25:45 user nova-compute[71330]:   </features>
Apr 14 12:25:45 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:25:45 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:25:45 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:25:45 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:25:45 user nova-compute[71330]:   </clock>
Apr 14 12:25:45 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:25:45 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:25:45 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:25:45 user nova-compute[71330]:   </cpu>
Apr 14 12:25:45 user nova-compute[71330]:   <devices>
Apr 14 12:25:45 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:25:45 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:25:45 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 12:25:45 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:25:45 user nova-compute[71330]:       <serial>bac8fa14-5f8b-4159-ba79-b5b0fa473d99</serial>
Apr 14 12:25:45 user nova-compute[71330]:     </disk>
Apr 14 12:25:45 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:25:45 user nova-compute[71330]:       <mac address="fa:16:3e:41:ca:65"/>
Apr 14 12:25:45 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:25:45 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:25:45 user nova-compute[71330]:       <target dev="tap8b52e74d-0e"/>
Apr 14 12:25:45 user nova-compute[71330]:     </interface>
Apr 14 12:25:45 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:25:45 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/22d88480-665d-4d11-b22f-998d58ed25f4/console.log" append="off"/>
Apr 14 12:25:45 user nova-compute[71330]:     </serial>
Apr 14 12:25:45 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:25:45 user nova-compute[71330]:     <video>
Apr 14 12:25:45 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:25:45 user nova-compute[71330]:     </video>
Apr 14 12:25:45 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:25:45 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:25:45 user nova-compute[71330]:     </rng>
Apr 14 12:25:45 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:25:45 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:25:45 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:25:45 user nova-compute[71330]:     </memballoon>
Apr 14 12:25:45 user nova-compute[71330]:   </devices>
Apr 14 12:25:45 user nova-compute[71330]: </domain>
Apr 14 12:25:45 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-660218859',display_name='tempest-TestShelveInstance-server-660218859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-660218859',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx73a5JRZ+Vcnm3BGIc9YGjGbFiNtAVL0mP06rY5GWLceZGaxSWT/qv0+RiU/G63lqlXep5Kc8i43AWTDBaUZb85XVPXi9LqBIdLi6RC3Ta56TQn5rmkT5zYjxJkAwSXw==',key_name='tempest-TestShelveInstance-53342841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='429cce7d6b244be8ba4f0ed36ed98863',ramdisk_id='',reservation_id='r-4z05b0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1593326624',owner_user_name='tempest-TestShelveInstance-1593326624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:25:38Z,user_data=None,user_id='0dcf77e350494142983fef3fd95ec080',uuid=22d88480-665d-4d11-b22f-998d58ed25f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converting VIF {"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG os_vif [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b52e74d-0e, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b52e74d-0e, col_values=(('external_ids', {'iface-id': '8b52e74d-0e38-439d-8857-f07336dea29c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:ca:65', 'vm-uuid': '22d88480-665d-4d11-b22f-998d58ed25f4'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:45 user nova-compute[71330]: INFO os_vif [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e')
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:25:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] No VIF found with MAC fa:16:3e:41:ca:65, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:25:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:25:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:46 user nova-compute[71330]: DEBUG nova.compute.manager [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] No waiting events found dispatching network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:25:46 user nova-compute[71330]: WARNING nova.compute.manager [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received unexpected event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c for instance with vm_state building and task_state spawning.
Apr 14 12:25:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:47 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475148.8413396, 22d88480-665d-4d11-b22f-998d58ed25f4 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:25:48 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] VM Resumed (Lifecycle Event)
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:25:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Instance spawned successfully.
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:25:48 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475148.842572, 22d88480-665d-4d11-b22f-998d58ed25f4 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:25:48 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] VM Started (Lifecycle Event)
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] No waiting events found dispatching network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:25:48 user nova-compute[71330]: WARNING nova.compute.manager [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received unexpected event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c for instance with vm_state building and task_state spawning.
Apr 14 12:25:48 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:25:48 user nova-compute[71330]: INFO nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Took 5.07 seconds to spawn the instance on the hypervisor.
Apr 14 12:25:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:25:49 user nova-compute[71330]: INFO nova.compute.manager [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Took 10.99 seconds to build instance.
Apr 14 12:25:49 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.077s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:25:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:25:59 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:25:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:25:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:25:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:25:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:25:59 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:25:59 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:26:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updating instance_info_cache with network_info: [{"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:26:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:26:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:26:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:26:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:26:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:26:04 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:26:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:26:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:26:07 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:26:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:26:13 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:26:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:26:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:26:13 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:26:13 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:26:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:26:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:26:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:26:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:26:14 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:26:14 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:26:14 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8561MB free_disk=26.228954315185547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 22d88480-665d-4d11-b22f-998d58ed25f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:26:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:26:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:26:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:26:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:26:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:26:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "bed9942b-9207-49ed-85d2-32523431cf1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "bed9942b-9207-49ed-85d2-32523431cf1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:26:31 user nova-compute[71330]: INFO nova.compute.claims [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Claim successful on node user
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:26:31 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.policy [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '182bf4ecd144494d91c6124547bcbb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62022b87cde84ab09e72c570f4f89623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:26:31 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Creating image(s)
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "/opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "/opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "/opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:26:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk 1073741824" returned: 0 in 0.046s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Successfully created port: 6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Cannot resize image /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.objects.instance [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lazy-loading 'migration_context' on Instance uuid bed9942b-9207-49ed-85d2-32523431cf1c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Ensure instance console log exists: /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Successfully updated port: 6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "refresh_cache-bed9942b-9207-49ed-85d2-32523431cf1c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquired lock "refresh_cache-bed9942b-9207-49ed-85d2-32523431cf1c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received event network-changed-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Refreshing instance network info cache due to event network-changed-6358dca2-b191-4d0c-998e-8a250a1a116f. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] Acquiring lock "refresh_cache-bed9942b-9207-49ed-85d2-32523431cf1c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:26:32 user nova-compute[71330]: DEBUG nova.network.neutron [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.network.neutron [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Updating instance_info_cache with network_info: [{"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Releasing lock "refresh_cache-bed9942b-9207-49ed-85d2-32523431cf1c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Instance network_info: |[{"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] Acquired lock "refresh_cache-bed9942b-9207-49ed-85d2-32523431cf1c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Refreshing network info cache for port 6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Start _get_guest_xml network_info=[{"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:26:33 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:26:33 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1344788342',display_name='tempest-VolumesActionsTest-instance-1344788342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1344788342',id=44,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62022b87cde84ab09e72c570f4f89623',ramdisk_id='',reservation_id='r-vuyiusrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1257339868',owner_user_name='tempest-VolumesActionsTest-1257339868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:26:32Z,user_data=None,user_id='182bf4ecd144494d91c6124547bcbb2c',uuid=bed9942b-9207-49ed-85d2-32523431cf1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Converting VIF {"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:8c:62,bridge_name='br-int',has_traffic_filtering=True,id=6358dca2-b191-4d0c-998e-8a250a1a116f,network=Network(9ed42a1c-e079-46f7-b368-3a430ba4e0f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6358dca2-b1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.objects.instance [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lazy-loading 'pci_devices' on Instance uuid bed9942b-9207-49ed-85d2-32523431cf1c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:26:33 user nova-compute[71330]:   <uuid>bed9942b-9207-49ed-85d2-32523431cf1c</uuid>
Apr 14 12:26:33 user nova-compute[71330]:   <name>instance-0000002c</name>
Apr 14 12:26:33 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:26:33 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:26:33 user nova-compute[71330]:   <metadata>
Apr 14 12:26:33 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:26:33 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:26:33 user nova-compute[71330]:       <nova:name>tempest-VolumesActionsTest-instance-1344788342</nova:name>
Apr 14 12:26:33 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:26:33</nova:creationTime>
Apr 14 12:26:33 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:26:33 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:26:33 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:26:33 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:26:33 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:26:33 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:26:33 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:26:33 user nova-compute[71330]:       <nova:owner>
Apr 14 12:26:33 user nova-compute[71330]:         <nova:user uuid="182bf4ecd144494d91c6124547bcbb2c">tempest-VolumesActionsTest-1257339868-project-member</nova:user>
Apr 14 12:26:33 user nova-compute[71330]:         <nova:project uuid="62022b87cde84ab09e72c570f4f89623">tempest-VolumesActionsTest-1257339868</nova:project>
Apr 14 12:26:33 user nova-compute[71330]:       </nova:owner>
Apr 14 12:26:33 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:26:33 user nova-compute[71330]:       <nova:ports>
Apr 14 12:26:33 user nova-compute[71330]:         <nova:port uuid="6358dca2-b191-4d0c-998e-8a250a1a116f">
Apr 14 12:26:33 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 14 12:26:33 user nova-compute[71330]:         </nova:port>
Apr 14 12:26:33 user nova-compute[71330]:       </nova:ports>
Apr 14 12:26:33 user nova-compute[71330]:     </nova:instance>
Apr 14 12:26:33 user nova-compute[71330]:   </metadata>
Apr 14 12:26:33 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:26:33 user nova-compute[71330]:     <system>
Apr 14 12:26:33 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:26:33 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:26:33 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:26:33 user nova-compute[71330]:       <entry name="serial">bed9942b-9207-49ed-85d2-32523431cf1c</entry>
Apr 14 12:26:33 user nova-compute[71330]:       <entry name="uuid">bed9942b-9207-49ed-85d2-32523431cf1c</entry>
Apr 14 12:26:33 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:26:33 user nova-compute[71330]:     </system>
Apr 14 12:26:33 user nova-compute[71330]:   </sysinfo>
Apr 14 12:26:33 user nova-compute[71330]:   <os>
Apr 14 12:26:33 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:26:33 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:26:33 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:26:33 user nova-compute[71330]:   </os>
Apr 14 12:26:33 user nova-compute[71330]:   <features>
Apr 14 12:26:33 user nova-compute[71330]:     <acpi/>
Apr 14 12:26:33 user nova-compute[71330]:     <apic/>
Apr 14 12:26:33 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:26:33 user nova-compute[71330]:   </features>
Apr 14 12:26:33 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:26:33 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:26:33 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:26:33 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:26:33 user nova-compute[71330]:   </clock>
Apr 14 12:26:33 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:26:33 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:26:33 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:26:33 user nova-compute[71330]:   </cpu>
Apr 14 12:26:33 user nova-compute[71330]:   <devices>
Apr 14 12:26:33 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:26:33 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:26:33 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk"/>
Apr 14 12:26:33 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:26:33 user nova-compute[71330]:     </disk>
Apr 14 12:26:33 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:26:33 user nova-compute[71330]:       <mac address="fa:16:3e:26:8c:62"/>
Apr 14 12:26:33 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:26:33 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:26:33 user nova-compute[71330]:       <target dev="tap6358dca2-b1"/>
Apr 14 12:26:33 user nova-compute[71330]:     </interface>
Apr 14 12:26:33 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:26:33 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/console.log" append="off"/>
Apr 14 12:26:33 user nova-compute[71330]:     </serial>
Apr 14 12:26:33 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:26:33 user nova-compute[71330]:     <video>
Apr 14 12:26:33 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:26:33 user nova-compute[71330]:     </video>
Apr 14 12:26:33 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:26:33 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:26:33 user nova-compute[71330]:     </rng>
Apr 14 12:26:33 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:26:33 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:26:33 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:26:33 user nova-compute[71330]:     </memballoon>
Apr 14 12:26:33 user nova-compute[71330]:   </devices>
Apr 14 12:26:33 user nova-compute[71330]: </domain>
Apr 14 12:26:33 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1344788342',display_name='tempest-VolumesActionsTest-instance-1344788342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1344788342',id=44,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62022b87cde84ab09e72c570f4f89623',ramdisk_id='',reservation_id='r-vuyiusrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1257339868',owner_user_name='tempest-VolumesActionsTest-1257339868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:26:32Z,user_data=None,user_id='182bf4ecd144494d91c6124547bcbb2c',uuid=bed9942b-9207-49ed-85d2-32523431cf1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Converting VIF {"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:8c:62,bridge_name='br-int',has_traffic_filtering=True,id=6358dca2-b191-4d0c-998e-8a250a1a116f,network=Network(9ed42a1c-e079-46f7-b368-3a430ba4e0f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6358dca2-b1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG os_vif [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:8c:62,bridge_name='br-int',has_traffic_filtering=True,id=6358dca2-b191-4d0c-998e-8a250a1a116f,network=Network(9ed42a1c-e079-46f7-b368-3a430ba4e0f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6358dca2-b1') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6358dca2-b1, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6358dca2-b1, col_values=(('external_ids', {'iface-id': '6358dca2-b191-4d0c-998e-8a250a1a116f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:8c:62', 'vm-uuid': 'bed9942b-9207-49ed-85d2-32523431cf1c'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:33 user nova-compute[71330]: INFO os_vif [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:8c:62,bridge_name='br-int',has_traffic_filtering=True,id=6358dca2-b191-4d0c-998e-8a250a1a116f,network=Network(9ed42a1c-e079-46f7-b368-3a430ba4e0f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6358dca2-b1')
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] No VIF found with MAC fa:16:3e:26:8c:62, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Updated VIF entry in instance network info cache for port 6358dca2-b191-4d0c-998e-8a250a1a116f. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Updating instance_info_cache with network_info: [{"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:26:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] Releasing lock "refresh_cache-bed9942b-9207-49ed-85d2-32523431cf1c" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:26:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received event network-vif-plugged-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:26:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] Acquiring lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:26:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:26:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:26:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] No waiting events found dispatching network-vif-plugged-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:26:35 user nova-compute[71330]: WARNING nova.compute.manager [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received unexpected event network-vif-plugged-6358dca2-b191-4d0c-998e-8a250a1a116f for instance with vm_state building and task_state spawning.
Apr 14 12:26:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received event network-vif-plugged-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] Acquiring lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] No waiting events found dispatching network-vif-plugged-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:26:37 user nova-compute[71330]: WARNING nova.compute.manager [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received unexpected event network-vif-plugged-6358dca2-b191-4d0c-998e-8a250a1a116f for instance with vm_state building and task_state spawning.
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475197.3563871, bed9942b-9207-49ed-85d2-32523431cf1c => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:26:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] VM Resumed (Lifecycle Event)
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:26:37 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Instance spawned successfully.
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:26:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475197.3567107, bed9942b-9207-49ed-85d2-32523431cf1c => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:26:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] VM Started (Lifecycle Event)
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:26:37 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:26:37 user nova-compute[71330]: INFO nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Took 5.77 seconds to spawn the instance on the hypervisor.
Apr 14 12:26:37 user nova-compute[71330]: DEBUG nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:26:37 user nova-compute[71330]: INFO nova.compute.manager [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Took 6.41 seconds to build instance.
Apr 14 12:26:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "bed9942b-9207-49ed-85d2-32523431cf1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.505s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:26:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:26:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:26:59 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:26:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:26:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:26:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:26:59 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:27:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:27:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:27:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:27:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:27:01 user nova-compute[71330]: DEBUG nova.compute.manager [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received event network-changed-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:27:01 user nova-compute[71330]: DEBUG nova.compute.manager [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Refreshing instance network info cache due to event network-changed-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:27:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] Acquiring lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:27:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] Acquired lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:27:01 user nova-compute[71330]: DEBUG nova.network.neutron [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Refreshing network info cache for port 9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:27:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updated VIF entry in instance network info cache for port 9759ea45-36a6-4d4d-b74e-cb8731fbdcd7. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:27:02 user nova-compute[71330]: DEBUG nova.network.neutron [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updating instance_info_cache with network_info: [{"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:27:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] Releasing lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:27:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:27:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:27:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'flavor' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:04 user nova-compute[71330]: INFO nova.compute.manager [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Attaching volume b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 to /dev/vdb
Apr 14 12:27:04 user nova-compute[71330]: DEBUG os_brick.utils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1546c50-f09c-4b63-92e4-d5b27508b166]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5d7278-8507-4f48-8912-14d2be4f4319]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[defc2a8a-675e-48f0-8eee-a8656a0f1790]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccf448a-a4c4-4f0d-8c11-183f76049abd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:27:04 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea2e2a-4a6f-4c47-a871-7194bbdaf1bb]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG os_brick.utils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updating existing volume attachment record: 9e6c92a2-a6eb-47f8-8780-5499ebc7b025 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:27:04 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:27:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:27:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:08 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlXDyFHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:27:09 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:27:09 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:27:09 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb92db6-7f00-4efa-9219-0bdca0df6382]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:27:09 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec2c0ba-ac8f-4d9a-b968-b0037f671708]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37] added
Apr 14 12:27:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac799c3-c22f-44a7-ab31-7c7c132ae983]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aef183d-6b18-4cc9-8165-ed2464961567]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlXDyFHi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlXDyFHi" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[46258723-6d81-4a84-a55b-597938c638f9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WlXDyFHi'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7465df-e605-4f97-9383-d1525241a6eb]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2c0f2-b2d6-4eb5-9a14-2173d68a0024]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:27:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:27:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa50ecd-68f2-4f63-9566-828af0d346ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37, portal: 172.16.0.220,3260]
Apr 14 12:27:09 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37, portal: 172.16.0.220,3260] successful.
Apr 14 12:27:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ef5386-0d03-456c-93c7-56ce9f1f0c4b]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc2b72a-d101-4aab-8f12-68ff7d08266a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:27:09 user nova-compute[71330]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:27:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:27:09 user nova-compute[71330]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:27:09 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d309880d-ae53-4ace-9288-29c8b6d96db4]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:27:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlXDyFHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26364383262353731', 'path': '/dev/sdc'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364383262353731', 'path': '/dev/sdc'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG nova.objects.instance [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'flavor' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:27:10 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:27:10 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:27:10 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:27:10 user nova-compute[71330]:   <serial>b46c7cd9-3c97-4269-8c2a-7ac57e02cc37</serial>
Apr 14 12:27:10 user nova-compute[71330]: </disk>
Apr 14 12:27:10 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No VIF found with MAC fa:16:3e:d8:5d:93, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:27:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.619s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:27:14 user nova-compute[71330]: INFO nova.compute.claims [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Claim successful on node user
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.243s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:27:14 user nova-compute[71330]: DEBUG nova.network.neutron [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:27:15 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:27:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG nova.policy [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:27:15 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Creating image(s)
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "/opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "/opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.132s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk 1073741824" returned: 0 in 0.085s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:27:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.network.neutron [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Successfully created port: 514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk --force-share --output=json" returned: 0 in 0.427s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Cannot resize image /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.objects.instance [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'migration_context' on Instance uuid f2f3f771-0dd9-4d26-a3e1-7872b6ef700e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:27:16 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:27:16 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8515MB free_disk=26.20724868774414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Ensure instance console log exists: /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 22d88480-665d-4d11-b22f-998d58ed25f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance bed9942b-9207-49ed-85d2-32523431cf1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:27:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.network.neutron [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Successfully updated port: 514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquired lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.network.neutron [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received event network-changed-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.compute.manager [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Refreshing instance network info cache due to event network-changed-514b556d-4464-4940-9b03-ad93a2fb5c6c. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] Acquiring lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.network.neutron [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.network.neutron [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Updating instance_info_cache with network_info: [{"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Releasing lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Instance network_info: |[{"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] Acquired lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.network.neutron [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Refreshing network info cache for port 514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Start _get_guest_xml network_info=[{"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:27:17 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:27:17 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1881217565',display_name='tempest-AttachVolumeNegativeTest-server-1881217565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1881217565',id=45,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASklcwtP5aGUHg3huDk+iSFj8z3lv03neDMPl61N00clNPmudnKMrGmZ7kJ3Awk8Ntvhr8XB5fIK4ExwZufNgalLlXDLs1/af7xeg1rmBjFxkdfa2k3zF5tFMklSQ+vjA==',key_name='tempest-keypair-103300990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-2w0v9xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=f2f3f771-0dd9-4d26-a3e1-7872b6ef700e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:3e:06,bridge_name='br-int',has_traffic_filtering=True,id=514b556d-4464-4940-9b03-ad93a2fb5c6c,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514b556d-44') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.objects.instance [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'pci_devices' on Instance uuid f2f3f771-0dd9-4d26-a3e1-7872b6ef700e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:27:17 user nova-compute[71330]:   <uuid>f2f3f771-0dd9-4d26-a3e1-7872b6ef700e</uuid>
Apr 14 12:27:17 user nova-compute[71330]:   <name>instance-0000002d</name>
Apr 14 12:27:17 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:27:17 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:27:17 user nova-compute[71330]:   <metadata>
Apr 14 12:27:17 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:27:17 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:27:17 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1881217565</nova:name>
Apr 14 12:27:17 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:27:17</nova:creationTime>
Apr 14 12:27:17 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:27:17 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:27:17 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:27:17 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:27:17 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:27:17 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:27:17 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:27:17 user nova-compute[71330]:       <nova:owner>
Apr 14 12:27:17 user nova-compute[71330]:         <nova:user uuid="609f2fce20c44000903c8a05e07ebd67">tempest-AttachVolumeNegativeTest-1138909145-project-member</nova:user>
Apr 14 12:27:17 user nova-compute[71330]:         <nova:project uuid="fa90860f65ab408aa00dfd6abb8af18b">tempest-AttachVolumeNegativeTest-1138909145</nova:project>
Apr 14 12:27:17 user nova-compute[71330]:       </nova:owner>
Apr 14 12:27:17 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:27:17 user nova-compute[71330]:       <nova:ports>
Apr 14 12:27:17 user nova-compute[71330]:         <nova:port uuid="514b556d-4464-4940-9b03-ad93a2fb5c6c">
Apr 14 12:27:17 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 12:27:17 user nova-compute[71330]:         </nova:port>
Apr 14 12:27:17 user nova-compute[71330]:       </nova:ports>
Apr 14 12:27:17 user nova-compute[71330]:     </nova:instance>
Apr 14 12:27:17 user nova-compute[71330]:   </metadata>
Apr 14 12:27:17 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:27:17 user nova-compute[71330]:     <system>
Apr 14 12:27:17 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:27:17 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:27:17 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:27:17 user nova-compute[71330]:       <entry name="serial">f2f3f771-0dd9-4d26-a3e1-7872b6ef700e</entry>
Apr 14 12:27:17 user nova-compute[71330]:       <entry name="uuid">f2f3f771-0dd9-4d26-a3e1-7872b6ef700e</entry>
Apr 14 12:27:17 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:27:17 user nova-compute[71330]:     </system>
Apr 14 12:27:17 user nova-compute[71330]:   </sysinfo>
Apr 14 12:27:17 user nova-compute[71330]:   <os>
Apr 14 12:27:17 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:27:17 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:27:17 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:27:17 user nova-compute[71330]:   </os>
Apr 14 12:27:17 user nova-compute[71330]:   <features>
Apr 14 12:27:17 user nova-compute[71330]:     <acpi/>
Apr 14 12:27:17 user nova-compute[71330]:     <apic/>
Apr 14 12:27:17 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:27:17 user nova-compute[71330]:   </features>
Apr 14 12:27:17 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:27:17 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:27:17 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:27:17 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:27:17 user nova-compute[71330]:   </clock>
Apr 14 12:27:17 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:27:17 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:27:17 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:27:17 user nova-compute[71330]:   </cpu>
Apr 14 12:27:17 user nova-compute[71330]:   <devices>
Apr 14 12:27:17 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:27:17 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:27:17 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk"/>
Apr 14 12:27:17 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:27:17 user nova-compute[71330]:     </disk>
Apr 14 12:27:17 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:27:17 user nova-compute[71330]:       <mac address="fa:16:3e:cc:3e:06"/>
Apr 14 12:27:17 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:27:17 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:27:17 user nova-compute[71330]:       <target dev="tap514b556d-44"/>
Apr 14 12:27:17 user nova-compute[71330]:     </interface>
Apr 14 12:27:17 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:27:17 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/console.log" append="off"/>
Apr 14 12:27:17 user nova-compute[71330]:     </serial>
Apr 14 12:27:17 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:27:17 user nova-compute[71330]:     <video>
Apr 14 12:27:17 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:27:17 user nova-compute[71330]:     </video>
Apr 14 12:27:17 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:27:17 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:27:17 user nova-compute[71330]:     </rng>
Apr 14 12:27:17 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:27:17 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:27:17 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:27:17 user nova-compute[71330]:     </memballoon>
Apr 14 12:27:17 user nova-compute[71330]:   </devices>
Apr 14 12:27:17 user nova-compute[71330]: </domain>
Apr 14 12:27:17 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1881217565',display_name='tempest-AttachVolumeNegativeTest-server-1881217565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1881217565',id=45,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASklcwtP5aGUHg3huDk+iSFj8z3lv03neDMPl61N00clNPmudnKMrGmZ7kJ3Awk8Ntvhr8XB5fIK4ExwZufNgalLlXDLs1/af7xeg1rmBjFxkdfa2k3zF5tFMklSQ+vjA==',key_name='tempest-keypair-103300990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-2w0v9xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=f2f3f771-0dd9-4d26-a3e1-7872b6ef700e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:3e:06,bridge_name='br-int',has_traffic_filtering=True,id=514b556d-4464-4940-9b03-ad93a2fb5c6c,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514b556d-44') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG os_vif [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:3e:06,bridge_name='br-int',has_traffic_filtering=True,id=514b556d-4464-4940-9b03-ad93a2fb5c6c,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514b556d-44') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap514b556d-44, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap514b556d-44, col_values=(('external_ids', {'iface-id': '514b556d-4464-4940-9b03-ad93a2fb5c6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:3e:06', 'vm-uuid': 'f2f3f771-0dd9-4d26-a3e1-7872b6ef700e'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:17 user nova-compute[71330]: INFO os_vif [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:3e:06,bridge_name='br-int',has_traffic_filtering=True,id=514b556d-4464-4940-9b03-ad93a2fb5c6c,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514b556d-44')
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:27:17 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No VIF found with MAC fa:16:3e:cc:3e:06, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:27:18 user nova-compute[71330]: DEBUG nova.network.neutron [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Updated VIF entry in instance network info cache for port 514b556d-4464-4940-9b03-ad93a2fb5c6c. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:27:18 user nova-compute[71330]: DEBUG nova.network.neutron [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Updating instance_info_cache with network_info: [{"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:27:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] Releasing lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:27:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received event network-vif-plugged-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:27:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] Acquiring lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:19 user nova-compute[71330]: DEBUG nova.compute.manager [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] No waiting events found dispatching network-vif-plugged-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:27:19 user nova-compute[71330]: WARNING nova.compute.manager [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received unexpected event network-vif-plugged-514b556d-4464-4940-9b03-ad93a2fb5c6c for instance with vm_state building and task_state spawning.
Apr 14 12:27:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475241.1861193, f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:27:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] VM Resumed (Lifecycle Event)
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:27:21 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Instance spawned successfully.
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:27:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475241.1894739, f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:27:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] VM Started (Lifecycle Event)
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received event network-vif-plugged-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] Acquiring lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.compute.manager [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] No waiting events found dispatching network-vif-plugged-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:27:21 user nova-compute[71330]: WARNING nova.compute.manager [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received unexpected event network-vif-plugged-514b556d-4464-4940-9b03-ad93a2fb5c6c for instance with vm_state building and task_state spawning.
Apr 14 12:27:21 user nova-compute[71330]: INFO nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Took 6.14 seconds to spawn the instance on the hypervisor.
Apr 14 12:27:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:27:21 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:27:21 user nova-compute[71330]: INFO nova.compute.manager [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Took 6.75 seconds to build instance.
Apr 14 12:27:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.845s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:27:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:27:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:27:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:27:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:27:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:27:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing instance network info cache due to event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:27:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:27:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:27:29 user nova-compute[71330]: DEBUG nova.network.neutron [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:30 user nova-compute[71330]: INFO nova.compute.manager [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Shelve offloading
Apr 14 12:27:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG nova.network.neutron [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updated VIF entry in instance network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG nova.network.neutron [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-unplugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] No waiting events found dispatching network-vif-unplugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:27:30 user nova-compute[71330]: WARNING nova.compute.manager [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received unexpected event network-vif-unplugged-8b52e74d-0e38-439d-8857-f07336dea29c for instance with vm_state active and task_state shelving.
Apr 14 12:27:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Instance destroyed successfully.
Apr 14 12:27:30 user nova-compute[71330]: DEBUG nova.compute.manager [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:27:30 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:27:31 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Instance destroyed successfully.
Apr 14 12:27:31 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lazy-loading 'resources' on Instance uuid 22d88480-665d-4d11-b22f-998d58ed25f4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-660218859',display_name='tempest-TestShelveInstance-server-660218859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-660218859',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx73a5JRZ+Vcnm3BGIc9YGjGbFiNtAVL0mP06rY5GWLceZGaxSWT/qv0+RiU/G63lqlXep5Kc8i43AWTDBaUZb85XVPXi9LqBIdLi6RC3Ta56TQn5rmkT5zYjxJkAwSXw==',key_name='tempest-TestShelveInstance-53342841',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='429cce7d6b244be8ba4f0ed36ed98863',ramdisk_id='',reservation_id='r-4z05b0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1593326624',owner_user_name='tempest-TestShelveInstance-1593326624-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:25:49Z,user_data=None,user_id='0dcf77e350494142983fef3fd95ec080',uuid=22d88480-665d-4d11-b22f-998d58ed25f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converting VIF {"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG os_vif [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b52e74d-0e, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:27:31 user nova-compute[71330]: INFO os_vif [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e')
Apr 14 12:27:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqvjNBWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:27:31 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:27:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:27:31 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb475305-f785-49dd-8dc7-92cd6b1e67d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:27:32 user nova-compute[71330]: No targets found.
Apr 14 12:27:32 user nova-compute[71330]: iSNS:
Apr 14 12:27:32 user nova-compute[71330]: No targets found.
Apr 14 12:27:32 user nova-compute[71330]: STATIC:
Apr 14 12:27:32 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99
Apr 14 12:27:32 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:27:32 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:27:32 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37
Apr 14 12:27:32 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:27:32 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:27:32 user nova-compute[71330]: FIRMWARE:
Apr 14 12:27:32 user nova-compute[71330]: No targets found.
Apr 14 12:27:32 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:27:32 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:27:32 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a47f16b-4c48-4ee8-b618-5a87392f6837]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b431bb-1dea-44a9-adbb-6ca620ea887f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:27:32 user nova-compute[71330]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:27:32 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:27:32 user nova-compute[71330]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:27:32 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49542415a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f83fce-e40b-4192-94f3-cd2945ad9d74]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ed4a4c-ce93-4d86-ab91-1002a50d11e7]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83e738e-653a-47ff-be94-33d2ec07f838]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e12796b-2c8e-4c15-bd41-fe569dccd16e]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1dfa0b-b772-453e-9236-58c1866615a1]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd1c46-d137-40bd-893f-6130933c1d64]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260]
Apr 14 12:27:32 user nova-compute[71330]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260] successful.
Apr 14 12:27:32 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b9dc2-e02f-44b1-909b-60724afff297]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] <== disconnect_volume: return (303ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:27:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Deleting instance files /opt/stack/data/nova/instances/22d88480-665d-4d11-b22f-998d58ed25f4_del
Apr 14 12:27:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Deletion of /opt/stack/data/nova/instances/22d88480-665d-4d11-b22f-998d58ed25f4_del complete
Apr 14 12:27:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] No waiting events found dispatching network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:27:32 user nova-compute[71330]: WARNING nova.compute.manager [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received unexpected event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c for instance with vm_state active and task_state shelving.
Apr 14 12:27:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing instance network info cache due to event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:27:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:27:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updated VIF entry in instance network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:27:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": null, "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:27:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:27:33 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Deleted allocations for instance 22d88480-665d-4d11-b22f-998d58ed25f4
Apr 14 12:27:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:27:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:27:33 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lazy-loading 'numa_topology' on Instance uuid 22d88480-665d-4d11-b22f-998d58ed25f4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:27:33 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:27:33 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:27:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.499s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:27:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:45 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475250.915499, 22d88480-665d-4d11-b22f-998d58ed25f4 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:27:45 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] VM Stopped (Lifecycle Event)
Apr 14 12:27:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-bdb5482e-e064-4bc7-90a8-e08bdeb20519 None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:27:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:27:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:27:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:27:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:27:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:27:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:27:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:28:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:28:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:28:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:28:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:28:00 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:28:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updating instance_info_cache with network_info: [{"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:28:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:28:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:28:01 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:28:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 12:28:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] There are 0 instances to clean {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 12:28:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:15 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:28:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:28:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:28:15 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:28:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:28:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:28:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:28:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:17 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:28:17 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8537MB free_disk=26.17794418334961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance bed9942b-9207-49ed-85d2-32523431cf1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing inventories for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating ProviderTree inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing aggregate associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, aggregates: None {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing trait associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:28:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:28:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:28:26 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:28:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:28:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:28:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:28:27 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "bed9942b-9207-49ed-85d2-32523431cf1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "bed9942b-9207-49ed-85d2-32523431cf1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:28:29 user nova-compute[71330]: INFO nova.compute.manager [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Terminating instance
Apr 14 12:28:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received event network-vif-unplugged-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] Acquiring lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] No waiting events found dispatching network-vif-unplugged-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:28:29 user nova-compute[71330]: DEBUG nova.compute.manager [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received event network-vif-unplugged-6358dca2-b191-4d0c-998e-8a250a1a116f for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Instance destroyed successfully.
Apr 14 12:28:30 user nova-compute[71330]: DEBUG nova.objects.instance [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lazy-loading 'resources' on Instance uuid bed9942b-9207-49ed-85d2-32523431cf1c {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1344788342',display_name='tempest-VolumesActionsTest-instance-1344788342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1344788342',id=44,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:26:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62022b87cde84ab09e72c570f4f89623',ramdisk_id='',reservation_id='r-vuyiusrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1257339868',owner_user_name='tempest-VolumesActionsTest-1257339868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:26:38Z,user_data=None,user_id='182bf4ecd144494d91c6124547bcbb2c',uuid=bed9942b-9207-49ed-85d2-32523431cf1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Converting VIF {"id": "6358dca2-b191-4d0c-998e-8a250a1a116f", "address": "fa:16:3e:26:8c:62", "network": {"id": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440151938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "62022b87cde84ab09e72c570f4f89623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6358dca2-b1", "ovs_interfaceid": "6358dca2-b191-4d0c-998e-8a250a1a116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:8c:62,bridge_name='br-int',has_traffic_filtering=True,id=6358dca2-b191-4d0c-998e-8a250a1a116f,network=Network(9ed42a1c-e079-46f7-b368-3a430ba4e0f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6358dca2-b1') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG os_vif [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:8c:62,bridge_name='br-int',has_traffic_filtering=True,id=6358dca2-b191-4d0c-998e-8a250a1a116f,network=Network(9ed42a1c-e079-46f7-b368-3a430ba4e0f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6358dca2-b1') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6358dca2-b1, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:28:30 user nova-compute[71330]: INFO os_vif [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:8c:62,bridge_name='br-int',has_traffic_filtering=True,id=6358dca2-b191-4d0c-998e-8a250a1a116f,network=Network(9ed42a1c-e079-46f7-b368-3a430ba4e0f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6358dca2-b1')
Apr 14 12:28:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Deleting instance files /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c_del
Apr 14 12:28:30 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Deletion of /opt/stack/data/nova/instances/bed9942b-9207-49ed-85d2-32523431cf1c_del complete
Apr 14 12:28:30 user nova-compute[71330]: INFO nova.compute.manager [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 14 12:28:30 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:28:30 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:28:31 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:28:31 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Took 0.63 seconds to deallocate network for instance.
Apr 14 12:28:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:28:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:28:31 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:28:31 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:28:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:28:31 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Deleted allocations for instance bed9942b-9207-49ed-85d2-32523431cf1c
Apr 14 12:28:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "bed9942b-9207-49ed-85d2-32523431cf1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.645s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:28:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received event network-vif-plugged-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:28:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] Acquiring lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:28:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:28:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] Lock "bed9942b-9207-49ed-85d2-32523431cf1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:28:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] No waiting events found dispatching network-vif-plugged-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:28:32 user nova-compute[71330]: WARNING nova.compute.manager [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received unexpected event network-vif-plugged-6358dca2-b191-4d0c-998e-8a250a1a116f for instance with vm_state deleted and task_state None.
Apr 14 12:28:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Received event network-vif-deleted-6358dca2-b191-4d0c-998e-8a250a1a116f {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:28:33 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances with incomplete migration  {{(pid=71330) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 12:28:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:28:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:45 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475310.323261, bed9942b-9207-49ed-85d2-32523431cf1c => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:28:45 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] VM Stopped (Lifecycle Event)
Apr 14 12:28:45 user nova-compute[71330]: DEBUG nova.compute.manager [None req-f8255205-e3ce-41e9-aa3e-6460e726aba2 None None] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:28:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:28:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:28:59 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:28:59 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:28:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:28:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:28:59 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:29:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:00 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Updating instance_info_cache with network_info: [{"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:29:00 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:29:00 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:29:00 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:29:04 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:29:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received event network-changed-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG nova.compute.manager [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Refreshing instance network info cache due to event network-changed-514b556d-4464-4940-9b03-ad93a2fb5c6c. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] Acquiring lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] Acquired lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG nova.network.neutron [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Refreshing network info cache for port 514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:05 user nova-compute[71330]: INFO nova.compute.manager [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Terminating instance
Apr 14 12:29:05 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:29:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Updated VIF entry in instance network info cache for port 514b556d-4464-4940-9b03-ad93a2fb5c6c. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.network.neutron [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Updating instance_info_cache with network_info: [{"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] Releasing lock "refresh_cache-f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received event network-vif-unplugged-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] Acquiring lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] No waiting events found dispatching network-vif-unplugged-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.compute.manager [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received event network-vif-unplugged-514b556d-4464-4940-9b03-ad93a2fb5c6c for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:29:06 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Instance destroyed successfully.
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'resources' on Instance uuid f2f3f771-0dd9-4d26-a3e1-7872b6ef700e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1881217565',display_name='tempest-AttachVolumeNegativeTest-server-1881217565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1881217565',id=45,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASklcwtP5aGUHg3huDk+iSFj8z3lv03neDMPl61N00clNPmudnKMrGmZ7kJ3Awk8Ntvhr8XB5fIK4ExwZufNgalLlXDLs1/af7xeg1rmBjFxkdfa2k3zF5tFMklSQ+vjA==',key_name='tempest-keypair-103300990',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:27:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-2w0v9xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:27:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=f2f3f771-0dd9-4d26-a3e1-7872b6ef700e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "address": "fa:16:3e:cc:3e:06", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514b556d-44", "ovs_interfaceid": "514b556d-4464-4940-9b03-ad93a2fb5c6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:3e:06,bridge_name='br-int',has_traffic_filtering=True,id=514b556d-4464-4940-9b03-ad93a2fb5c6c,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514b556d-44') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG os_vif [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:3e:06,bridge_name='br-int',has_traffic_filtering=True,id=514b556d-4464-4940-9b03-ad93a2fb5c6c,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514b556d-44') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap514b556d-44, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:06 user nova-compute[71330]: INFO os_vif [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:3e:06,bridge_name='br-int',has_traffic_filtering=True,id=514b556d-4464-4940-9b03-ad93a2fb5c6c,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514b556d-44')
Apr 14 12:29:06 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Deleting instance files /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e_del
Apr 14 12:29:06 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Deletion of /opt/stack/data/nova/instances/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e_del complete
Apr 14 12:29:06 user nova-compute[71330]: INFO nova.compute.manager [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 14 12:29:06 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:29:06 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:29:07 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:29:07 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Took 0.71 seconds to deallocate network for instance.
Apr 14 12:29:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:07 user nova-compute[71330]: DEBUG nova.compute.manager [req-18a732ec-7017-467e-b149-7264fc9608bd req-cefeadde-1522-47e4-9dec-4ad9b79a4762 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received event network-vif-deleted-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:29:07 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:29:07 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:29:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:07 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Deleted allocations for instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e
Apr 14 12:29:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.667s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:29:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received event network-vif-plugged-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:29:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] Acquiring lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] Lock "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:08 user nova-compute[71330]: DEBUG nova.compute.manager [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] No waiting events found dispatching network-vif-plugged-514b556d-4464-4940-9b03-ad93a2fb5c6c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:29:08 user nova-compute[71330]: WARNING nova.compute.manager [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Received unexpected event network-vif-plugged-514b556d-4464-4940-9b03-ad93a2fb5c6c for instance with vm_state deleted and task_state None.
Apr 14 12:29:08 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:29:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:29:10 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:29:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:29:15 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:29:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:15 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:15 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:29:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:15 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:16 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:29:16 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:29:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8678MB free_disk=26.214946746826172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:29:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:17 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475346.3798583, f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:29:21 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] VM Stopped (Lifecycle Event)
Apr 14 12:29:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-a866f0e6-d00b-4baa-869f-5630ecfa7a61 None None] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:21 user nova-compute[71330]: INFO nova.compute.manager [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Unshelving
Apr 14 12:29:21 user nova-compute[71330]: INFO nova.virt.block_device [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Booting with volume bac8fa14-5f8b-4159-ba79-b5b0fa473d99 at /dev/vda
Apr 14 12:29:21 user nova-compute[71330]: DEBUG os_brick.utils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ae8307-9e9f-4161-bd70-ba6cf80c19d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[9061ca10-c44d-4c26-a539-d1f0c591f2e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bfb8fe-d89c-4b2f-9be7-a17e738dad84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ed16a-67ee-43f5-b1c7-33f11ce8e9f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:29:21 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:29:21 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e618c-6db2-4fc9-9fd6-76bdf0abaf10]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG os_brick.utils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:29:21 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating existing volume attachment record: bde0a914-cc19-4110-b52b-f04d9fe762ff {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:29:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lazy-loading 'pci_requests' on Instance uuid 22d88480-665d-4d11-b22f-998d58ed25f4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:29:26 user nova-compute[71330]: DEBUG nova.objects.instance [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lazy-loading 'numa_topology' on Instance uuid 22d88480-665d-4d11-b22f-998d58ed25f4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:29:26 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:29:26 user nova-compute[71330]: INFO nova.compute.claims [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Claim successful on node user
Apr 14 12:29:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:29:26 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:29:26 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:29:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:26 user nova-compute[71330]: INFO nova.network.neutron [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating port 8b52e74d-0e38-439d-8857-f07336dea29c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.compute.manager [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing instance network info cache due to event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.network.neutron [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:29:27 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Creating image(s)
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Did not create local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Ensure instance console log exists: /opt/stack/data/nova/instances/22d88480-665d-4d11-b22f-998d58ed25f4/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Start _get_guest_xml network_info=[{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'bde0a914-cc19-4110-b52b-f04d9fe762ff', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqvjNBWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22d88480-665d-4d11-b22f-998d58ed25f4', 'attached_at': '', 'detached_at': '', 'volume_id': 'bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'serial': 'bac8fa14-5f8b-4159-ba79-b5b0fa473d99'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.network.neutron [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:29:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:29:27 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.objects.instance [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lazy-loading 'vcpu_model' on Instance uuid 22d88480-665d-4d11-b22f-998d58ed25f4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqvjNBWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:29:27 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:29:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:29:27 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:29:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:29:27 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[10193d9d-3626-47aa-bab3-d339619cc5f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:29:27 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[204dd93d-cd53-4651-a6b1-0cdfdb6ebfdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99] added
Apr 14 12:29:27 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4299e6-714f-4fec-a0fe-d0191a9c7036]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[626255df-882e-4fb9-a5a0-06db4fc87817]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:27 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqvjNBWm {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqvjNBWm" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a84b5-2237-4037-9eef-c26576d57847]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KqvjNBWm'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15b4985-f3c0-4311-8fed-b2c572a59167]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[45663429-fc34-47ce-b8ff-d24e694d779f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:29:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:29:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f87b273-ae05-49ca-ba55-e1123577ece9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260]
Apr 14 12:29:28 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260] successful.
Apr 14 12:29:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09802fc-23f2-4b1c-b219-af24a82b46c9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[725dbf85-62cf-4e58-a9a4-9c4b52622548]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:29:28 user nova-compute[71330]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:29:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:29:28 user nova-compute[71330]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:29:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbe9d53-25aa-4e2b-ac7d-0e1520555522]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqvjNBWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG nova.network.neutron [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updated VIF entry in instance network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG nova.network.neutron [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:29:28 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23935363566343262', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935363566343262', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-660218859',display_name='tempest-TestShelveInstance-server-660218859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-660218859',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-53342841',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='429cce7d6b244be8ba4f0ed36ed98863',ramdisk_id='',reservation_id='r-4z05b0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1593326624',owner_user_name='tempest-TestShelveInstance-1593326624-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:29:22Z,user_data=None,user_id='0dcf77e350494142983fef3fd95ec080',uuid=22d88480-665d-4d11-b22f-998d58ed25f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converting VIF {"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.objects.instance [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lazy-loading 'pci_devices' on Instance uuid 22d88480-665d-4d11-b22f-998d58ed25f4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:29:29 user nova-compute[71330]:   <uuid>22d88480-665d-4d11-b22f-998d58ed25f4</uuid>
Apr 14 12:29:29 user nova-compute[71330]:   <name>instance-0000002b</name>
Apr 14 12:29:29 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:29:29 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:29:29 user nova-compute[71330]:   <metadata>
Apr 14 12:29:29 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:29:29 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:29:29 user nova-compute[71330]:       <nova:name>tempest-TestShelveInstance-server-660218859</nova:name>
Apr 14 12:29:29 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:29:27</nova:creationTime>
Apr 14 12:29:29 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:29:29 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:29:29 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:29:29 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:29:29 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:29:29 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:29:29 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:29:29 user nova-compute[71330]:       <nova:owner>
Apr 14 12:29:29 user nova-compute[71330]:         <nova:user uuid="0dcf77e350494142983fef3fd95ec080">tempest-TestShelveInstance-1593326624-project-member</nova:user>
Apr 14 12:29:29 user nova-compute[71330]:         <nova:project uuid="429cce7d6b244be8ba4f0ed36ed98863">tempest-TestShelveInstance-1593326624</nova:project>
Apr 14 12:29:29 user nova-compute[71330]:       </nova:owner>
Apr 14 12:29:29 user nova-compute[71330]:       <nova:ports>
Apr 14 12:29:29 user nova-compute[71330]:         <nova:port uuid="8b52e74d-0e38-439d-8857-f07336dea29c">
Apr 14 12:29:29 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 12:29:29 user nova-compute[71330]:         </nova:port>
Apr 14 12:29:29 user nova-compute[71330]:       </nova:ports>
Apr 14 12:29:29 user nova-compute[71330]:     </nova:instance>
Apr 14 12:29:29 user nova-compute[71330]:   </metadata>
Apr 14 12:29:29 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:29:29 user nova-compute[71330]:     <system>
Apr 14 12:29:29 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:29:29 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:29:29 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:29:29 user nova-compute[71330]:       <entry name="serial">22d88480-665d-4d11-b22f-998d58ed25f4</entry>
Apr 14 12:29:29 user nova-compute[71330]:       <entry name="uuid">22d88480-665d-4d11-b22f-998d58ed25f4</entry>
Apr 14 12:29:29 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:29:29 user nova-compute[71330]:     </system>
Apr 14 12:29:29 user nova-compute[71330]:   </sysinfo>
Apr 14 12:29:29 user nova-compute[71330]:   <os>
Apr 14 12:29:29 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:29:29 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:29:29 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:29:29 user nova-compute[71330]:   </os>
Apr 14 12:29:29 user nova-compute[71330]:   <features>
Apr 14 12:29:29 user nova-compute[71330]:     <acpi/>
Apr 14 12:29:29 user nova-compute[71330]:     <apic/>
Apr 14 12:29:29 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:29:29 user nova-compute[71330]:   </features>
Apr 14 12:29:29 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:29:29 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:29:29 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:29:29 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:29:29 user nova-compute[71330]:   </clock>
Apr 14 12:29:29 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:29:29 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:29:29 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:29:29 user nova-compute[71330]:   </cpu>
Apr 14 12:29:29 user nova-compute[71330]:   <devices>
Apr 14 12:29:29 user nova-compute[71330]:     <disk type="block" device="disk">
Apr 14 12:29:29 user nova-compute[71330]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:29:29 user nova-compute[71330]:       <source dev="/dev/sdb"/>
Apr 14 12:29:29 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:29:29 user nova-compute[71330]:       <serial>bac8fa14-5f8b-4159-ba79-b5b0fa473d99</serial>
Apr 14 12:29:29 user nova-compute[71330]:     </disk>
Apr 14 12:29:29 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:29:29 user nova-compute[71330]:       <mac address="fa:16:3e:41:ca:65"/>
Apr 14 12:29:29 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:29:29 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:29:29 user nova-compute[71330]:       <target dev="tap8b52e74d-0e"/>
Apr 14 12:29:29 user nova-compute[71330]:     </interface>
Apr 14 12:29:29 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:29:29 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/22d88480-665d-4d11-b22f-998d58ed25f4/console.log" append="off"/>
Apr 14 12:29:29 user nova-compute[71330]:     </serial>
Apr 14 12:29:29 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:29:29 user nova-compute[71330]:     <video>
Apr 14 12:29:29 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:29:29 user nova-compute[71330]:     </video>
Apr 14 12:29:29 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:29:29 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:29:29 user nova-compute[71330]:     </rng>
Apr 14 12:29:29 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:29:29 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:29:29 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:29:29 user nova-compute[71330]:     </memballoon>
Apr 14 12:29:29 user nova-compute[71330]:   </devices>
Apr 14 12:29:29 user nova-compute[71330]: </domain>
Apr 14 12:29:29 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-660218859',display_name='tempest-TestShelveInstance-server-660218859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-660218859',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-53342841',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='429cce7d6b244be8ba4f0ed36ed98863',ramdisk_id='',reservation_id='r-4z05b0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1593326624',owner_user_name='tempest-TestShelveInstance-1593326624-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:29:22Z,user_data=None,user_id='0dcf77e350494142983fef3fd95ec080',uuid=22d88480-665d-4d11-b22f-998d58ed25f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converting VIF {"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG os_vif [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b52e74d-0e, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b52e74d-0e, col_values=(('external_ids', {'iface-id': '8b52e74d-0e38-439d-8857-f07336dea29c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:ca:65', 'vm-uuid': '22d88480-665d-4d11-b22f-998d58ed25f4'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:29 user nova-compute[71330]: INFO os_vif [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e')
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:29:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] No VIF found with MAC fa:16:3e:41:ca:65, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:29:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:29:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:30 user nova-compute[71330]: DEBUG nova.compute.manager [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] No waiting events found dispatching network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:29:30 user nova-compute[71330]: WARNING nova.compute.manager [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received unexpected event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 12:29:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:29:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:32 user nova-compute[71330]: DEBUG nova.compute.manager [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] No waiting events found dispatching network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:29:32 user nova-compute[71330]: WARNING nova.compute.manager [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received unexpected event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 12:29:32 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475372.9514987, 22d88480-665d-4d11-b22f-998d58ed25f4 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:29:32 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] VM Resumed (Lifecycle Event)
Apr 14 12:29:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:29:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:29:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Instance spawned successfully.
Apr 14 12:29:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:29:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:29:32 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:29:33 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:29:33 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475372.9529927, 22d88480-665d-4d11-b22f-998d58ed25f4 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:29:33 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] VM Started (Lifecycle Event)
Apr 14 12:29:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:29:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.362s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:33 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:29:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:29:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:29:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:29:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:29:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:29:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:29:57 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:29:57 user nova-compute[71330]: INFO nova.compute.manager [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Detaching volume b46c7cd9-3c97-4269-8c2a-7ac57e02cc37
Apr 14 12:29:57 user nova-compute[71330]: INFO nova.virt.block_device [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Attempting to driver detach volume b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 from mountpoint /dev/vdb
Apr 14 12:29:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Attempting to detach device vdb from instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:29:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:29:57 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:29:57 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:29:57 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:29:57 user nova-compute[71330]:   <serial>b46c7cd9-3c97-4269-8c2a-7ac57e02cc37</serial>
Apr 14 12:29:57 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:29:57 user nova-compute[71330]: </disk>
Apr 14 12:29:57 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:29:57 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully detached device vdb from instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 from the persistent domain config.
Apr 14 12:29:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:29:57 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:29:57 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:29:57 user nova-compute[71330]:   <source dev="/dev/sdc"/>
Apr 14 12:29:57 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:29:57 user nova-compute[71330]:   <serial>b46c7cd9-3c97-4269-8c2a-7ac57e02cc37</serial>
Apr 14 12:29:57 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:29:57 user nova-compute[71330]: </disk>
Apr 14 12:29:57 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681475398.040219, e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:29:58 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully detached device vdb from instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 from the live domain config.
Apr 14 12:29:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlXDyFHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:29:58 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d586d2c-e217-48d8-9a5b-70c274550d59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:29:58 user nova-compute[71330]: No targets found.
Apr 14 12:29:58 user nova-compute[71330]: iSNS:
Apr 14 12:29:58 user nova-compute[71330]: No targets found.
Apr 14 12:29:58 user nova-compute[71330]: STATIC:
Apr 14 12:29:58 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99
Apr 14 12:29:58 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:29:58 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:29:58 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37
Apr 14 12:29:58 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:29:58 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:29:58 user nova-compute[71330]: FIRMWARE:
Apr 14 12:29:58 user nova-compute[71330]: No targets found.
Apr 14 12:29:58 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:29:58 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:29:58 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7856d4c1-36ef-458e-b19b-3bf8eb4fe50b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8f5844-a77b-4fda-b78b-dbeec309efea]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:29:58 user nova-compute[71330]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:29:58 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 (non-flash)
Apr 14 12:29:58 user nova-compute[71330]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:29:58 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f493c20e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37'): ({'sdc'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Removing single pathed devices sdc {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ea3876-8d15-4603-8af2-ce2fb7eac817]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e2ce96-8e5a-4027-88f1-380aad6da2e7]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flushing IO for device /dev/sdc {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5b949e-9017-40de-b8bb-bfeb383f9158]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8aca45-38d0-493d-87ca-a58857085185]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] SCSI volumes sdc have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[69826361-6386-4587-8d21-d915ca4bccd3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0983c222-42ff-474a-b647-0f7656bd096f]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37, portal: 172.16.0.220,3260]
Apr 14 12:29:58 user nova-compute[71330]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37, portal: 172.16.0.220,3260] successful.
Apr 14 12:29:58 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bcdadf-9438-4300-80ae-aa728c7aacc9]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] <== disconnect_volume: return (285ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:29:58 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:29:59 user nova-compute[71330]: DEBUG nova.objects.instance [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'flavor' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:29:59 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:29:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:01 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:30:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:30:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:30:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:30:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:30:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:30:01 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:30:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updating instance_info_cache with network_info: [{"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:30:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-e4c20f68-5164-4e7e-b699-5d0ad9bd3141" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:30:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:30:02 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:30:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:30:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:30:08 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:30:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:30:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:30:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:30:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:30:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:16 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:30:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:30:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:30:16 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:30:16 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:30:16 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71330) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 12:30:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:30:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:30:16 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:30:17 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:30:17 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:30:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=26.211292266845703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 22d88480-665d-4d11-b22f-998d58ed25f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:30:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:30:18 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:30:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:30:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:30:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:30:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:30:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:30:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:30:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:30:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:30:48 user nova-compute[71330]: INFO nova.compute.manager [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Terminating instance
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.compute.manager [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received event network-vif-unplugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] No waiting events found dispatching network-vif-unplugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.compute.manager [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received event network-vif-unplugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Instance destroyed successfully.
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.objects.instance [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'resources' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1762137749',display_name='tempest-AttachVolumeNegativeTest-server-1762137749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1762137749',id=42,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8ZqjJNlf6FcYJIsVPd5Dq8NarYmFZ3EAxa4FpVKDQXSqboh3ngEuQm+3/ETqlNE/NPRoxD1k/GMhVZVbSixZx64hLBNYP8cF904WSQYGVXi3AQ5hvMZKO37FrgHGj9HQ==',key_name='tempest-keypair-1947744203',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-nj7qq444',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:25:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=e4c20f68-5164-4e7e-b699-5d0ad9bd3141,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "address": "fa:16:3e:d8:5d:93", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ea45-36", "ovs_interfaceid": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5d:93,bridge_name='br-int',has_traffic_filtering=True,id=9759ea45-36a6-4d4d-b74e-cb8731fbdcd7,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ea45-36') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG os_vif [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5d:93,bridge_name='br-int',has_traffic_filtering=True,id=9759ea45-36a6-4d4d-b74e-cb8731fbdcd7,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ea45-36') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9759ea45-36, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:30:48 user nova-compute[71330]: INFO os_vif [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5d:93,bridge_name='br-int',has_traffic_filtering=True,id=9759ea45-36a6-4d4d-b74e-cb8731fbdcd7,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ea45-36')
Apr 14 12:30:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Deleting instance files /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141_del
Apr 14 12:30:48 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Deletion of /opt/stack/data/nova/instances/e4c20f68-5164-4e7e-b699-5d0ad9bd3141_del complete
Apr 14 12:30:48 user nova-compute[71330]: INFO nova.compute.manager [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 12:30:48 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:30:48 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received event network-vif-deleted-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:30:50 user nova-compute[71330]: INFO nova.compute.manager [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Neutron deleted interface 9759ea45-36a6-4d4d-b74e-cb8731fbdcd7; detaching it from the instance and deleting it from the info cache
Apr 14 12:30:50 user nova-compute[71330]: DEBUG nova.network.neutron [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:30:50 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Took 1.25 seconds to deallocate network for instance.
Apr 14 12:30:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Detach interface failed, port_id=9759ea45-36a6-4d4d-b74e-cb8731fbdcd7, reason: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. {{(pid=71330) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received event network-vif-plugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] Acquiring lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:30:50 user nova-compute[71330]: DEBUG nova.compute.manager [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] No waiting events found dispatching network-vif-plugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:30:50 user nova-compute[71330]: WARNING nova.compute.manager [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Received unexpected event network-vif-plugged-9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance with vm_state deleted and task_state None.
Apr 14 12:30:50 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Deleted allocations for instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141
Apr 14 12:30:50 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e4c20f68-5164-4e7e-b699-5d0ad9bd3141" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.484s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:30:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:30:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:01 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:01 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:31:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:31:01 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:31:01 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:31:02 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:31:02 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:31:02 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:31:02 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:03 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475448.7845368, e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:31:03 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] VM Stopped (Lifecycle Event)
Apr 14 12:31:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-5df4aa1d-defe-4d75-a377-b1eb9e643389 None None] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:31:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:31:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:31:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:11 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG nova.compute.manager [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing instance network info cache due to event network-changed-8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] Acquiring lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] Acquired lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG nova.network.neutron [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Refreshing network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:12 user nova-compute[71330]: INFO nova.compute.manager [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Terminating instance
Apr 14 12:31:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG nova.network.neutron [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updated VIF entry in instance network info cache for port 8b52e74d-0e38-439d-8857-f07336dea29c. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG nova.network.neutron [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [{"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:31:12 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] Releasing lock "refresh_cache-22d88480-665d-4d11-b22f-998d58ed25f4" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:31:13 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Instance destroyed successfully.
Apr 14 12:31:13 user nova-compute[71330]: DEBUG nova.objects.instance [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lazy-loading 'resources' on Instance uuid 22d88480-665d-4d11-b22f-998d58ed25f4 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T12:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-660218859',display_name='tempest-TestShelveInstance-server-660218859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-660218859',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx73a5JRZ+Vcnm3BGIc9YGjGbFiNtAVL0mP06rY5GWLceZGaxSWT/qv0+RiU/G63lqlXep5Kc8i43AWTDBaUZb85XVPXi9LqBIdLi6RC3Ta56TQn5rmkT5zYjxJkAwSXw==',key_name='tempest-TestShelveInstance-53342841',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:29:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='429cce7d6b244be8ba4f0ed36ed98863',ramdisk_id='',reservation_id='r-4z05b0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1593326624',owner_user_name='tempest-TestShelveInstance-1593326624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:29:33Z,user_data=None,user_id='0dcf77e350494142983fef3fd95ec080',uuid=22d88480-665d-4d11-b22f-998d58ed25f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converting VIF {"id": "8b52e74d-0e38-439d-8857-f07336dea29c", "address": "fa:16:3e:41:ca:65", "network": {"id": "915c6366-7834-4d13-916f-c1513ddacc12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1886055750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "429cce7d6b244be8ba4f0ed36ed98863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b52e74d-0e", "ovs_interfaceid": "8b52e74d-0e38-439d-8857-f07336dea29c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_vif [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b52e74d-0e, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:31:13 user nova-compute[71330]: INFO os_vif [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:ca:65,bridge_name='br-int',has_traffic_filtering=True,id=8b52e74d-0e38-439d-8857-f07336dea29c,network=Network(915c6366-7834-4d13-916f-c1513ddacc12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b52e74d-0e')
Apr 14 12:31:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqvjNBWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:31:13 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2454e4ec-8083-41fc-bc68-5c75af52de52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:31:13 user nova-compute[71330]: No targets found.
Apr 14 12:31:13 user nova-compute[71330]: iSNS:
Apr 14 12:31:13 user nova-compute[71330]: No targets found.
Apr 14 12:31:13 user nova-compute[71330]: STATIC:
Apr 14 12:31:13 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99
Apr 14 12:31:13 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:31:13 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:31:13 user nova-compute[71330]: FIRMWARE:
Apr 14 12:31:13 user nova-compute[71330]: No targets found.
Apr 14 12:31:13 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:31:13 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:31:13 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5549692e-43a7-4724-ae01-80e0c6ebc3db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f784c77-3f8a-414d-8e5e-54863fa3156a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:31:13 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 (non-flash)
Apr 14 12:31:13 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495f9b5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c480d0f-fb77-4ac2-ae47-a045153553a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ccb87f-2614-4751-b66c-2e1a1e46bbd3]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b98802a-250f-4ba1-b080-af9a058b2751]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[24143175-5b3c-47cd-bda9-d38149b63f9f]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a62cc-1746-497e-bf52-ba4513a2875f]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecacaf2-1213-408b-b250-1f859db711dd]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260]
Apr 14 12:31:13 user nova-compute[71330]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99, portal: 172.16.0.220,3260] successful.
Apr 14 12:31:13 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bac8fa14-5f8b-4159-ba79-b5b0fa473d99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ef3fd1-12ac-47c5-922f-c7f312bf1b7e]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] <== disconnect_volume: return (310ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:31:13 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Deleting instance files /opt/stack/data/nova/instances/22d88480-665d-4d11-b22f-998d58ed25f4_del
Apr 14 12:31:13 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Deletion of /opt/stack/data/nova/instances/22d88480-665d-4d11-b22f-998d58ed25f4_del complete
Apr 14 12:31:13 user nova-compute[71330]: INFO nova.compute.manager [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 14 12:31:13 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:31:13 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:31:13 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Took 0.44 seconds to deallocate network for instance.
Apr 14 12:31:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-unplugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] No waiting events found dispatching network-vif-unplugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-unplugged-8b52e74d-0e38-439d-8857-f07336dea29c for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Acquiring lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Lock "22d88480-665d-4d11-b22f-998d58ed25f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] No waiting events found dispatching network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:31:14 user nova-compute[71330]: WARNING nova.compute.manager [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received unexpected event network-vif-plugged-8b52e74d-0e38-439d-8857-f07336dea29c for instance with vm_state active and task_state deleting.
Apr 14 12:31:14 user nova-compute[71330]: DEBUG nova.compute.manager [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Received event network-vif-deleted-8b52e74d-0e38-439d-8857-f07336dea29c {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:31:14 user nova-compute[71330]: INFO nova.compute.manager [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Took 0.75 seconds to detach 1 volumes for instance.
Apr 14 12:31:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Deleting volume: bac8fa14-5f8b-4159-ba79-b5b0fa473d99 {{(pid=71330) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:14 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Deleted allocations for instance 22d88480-665d-4d11-b22f-998d58ed25f4
Apr 14 12:31:14 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "22d88480-665d-4d11-b22f-998d58ed25f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.715s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:16 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:16 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:17 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:31:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:18 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:31:18 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:31:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=26.222244262695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:31:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:31:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:31:18 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:31:18 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:31:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:31:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:31:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:31:28 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475473.0130832, 22d88480-665d-4d11-b22f-998d58ed25f4 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:31:28 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] VM Stopped (Lifecycle Event)
Apr 14 12:31:28 user nova-compute[71330]: DEBUG nova.compute.manager [None req-01f93a6e-11a5-4040-ad65-5ccdd6707ca0 None None] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:31:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:31:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:31:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:41 user nova-compute[71330]: DEBUG nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:31:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:41 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:41 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:31:41 user nova-compute[71330]: INFO nova.compute.claims [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Claim successful on node user
Apr 14 12:31:41 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:31:41 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.network.neutron [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:31:42 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.policy [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:31:42 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Creating image(s)
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "/opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "/opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "/opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.143s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk 1073741824" returned: 0 in 0.060s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.network.neutron [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Successfully created port: ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Cannot resize image /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.objects.instance [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'migration_context' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Ensure instance console log exists: /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:42 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Successfully updated port: ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquired lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG nova.compute.manager [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received event network-changed-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG nova.compute.manager [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Refreshing instance network info cache due to event network-changed-ee784ad2-eed9-4260-8453-ec383447cf95. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] Acquiring lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG nova.network.neutron [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updating instance_info_cache with network_info: [{"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Releasing lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Instance network_info: |[{"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] Acquired lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG nova.network.neutron [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Refreshing network info cache for port ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:31:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Start _get_guest_xml network_info=[{"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:31:43 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:31:43 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-832590332',display_name='tempest-AttachVolumeNegativeTest-server-832590332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-832590332',id=46,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2n5YSC8QMWr5ck/++fyFR/Fek+st2PLAyRrIwipvxs2xnAN6MraEIVp9207YHntKSVZ9PMpam6j0695iHSPTsBnHlLA/TzEiQ0thDtndaSKOfJf6+r+dyJvHmFdggZOA==',key_name='tempest-keypair-1226525242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-cyrj2jir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=e52b7ccd-2e66-4579-bcdf-3059dfac872e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ac:01,bridge_name='br-int',has_traffic_filtering=True,id=ee784ad2-eed9-4260-8453-ec383447cf95,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee784ad2-ee') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.objects.instance [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'pci_devices' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:31:44 user nova-compute[71330]:   <uuid>e52b7ccd-2e66-4579-bcdf-3059dfac872e</uuid>
Apr 14 12:31:44 user nova-compute[71330]:   <name>instance-0000002e</name>
Apr 14 12:31:44 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:31:44 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:31:44 user nova-compute[71330]:   <metadata>
Apr 14 12:31:44 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:31:44 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:31:44 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeNegativeTest-server-832590332</nova:name>
Apr 14 12:31:44 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:31:43</nova:creationTime>
Apr 14 12:31:44 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:31:44 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:31:44 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:31:44 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:31:44 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:31:44 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:31:44 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:31:44 user nova-compute[71330]:       <nova:owner>
Apr 14 12:31:44 user nova-compute[71330]:         <nova:user uuid="609f2fce20c44000903c8a05e07ebd67">tempest-AttachVolumeNegativeTest-1138909145-project-member</nova:user>
Apr 14 12:31:44 user nova-compute[71330]:         <nova:project uuid="fa90860f65ab408aa00dfd6abb8af18b">tempest-AttachVolumeNegativeTest-1138909145</nova:project>
Apr 14 12:31:44 user nova-compute[71330]:       </nova:owner>
Apr 14 12:31:44 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:31:44 user nova-compute[71330]:       <nova:ports>
Apr 14 12:31:44 user nova-compute[71330]:         <nova:port uuid="ee784ad2-eed9-4260-8453-ec383447cf95">
Apr 14 12:31:44 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 12:31:44 user nova-compute[71330]:         </nova:port>
Apr 14 12:31:44 user nova-compute[71330]:       </nova:ports>
Apr 14 12:31:44 user nova-compute[71330]:     </nova:instance>
Apr 14 12:31:44 user nova-compute[71330]:   </metadata>
Apr 14 12:31:44 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:31:44 user nova-compute[71330]:     <system>
Apr 14 12:31:44 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:31:44 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:31:44 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:31:44 user nova-compute[71330]:       <entry name="serial">e52b7ccd-2e66-4579-bcdf-3059dfac872e</entry>
Apr 14 12:31:44 user nova-compute[71330]:       <entry name="uuid">e52b7ccd-2e66-4579-bcdf-3059dfac872e</entry>
Apr 14 12:31:44 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:31:44 user nova-compute[71330]:     </system>
Apr 14 12:31:44 user nova-compute[71330]:   </sysinfo>
Apr 14 12:31:44 user nova-compute[71330]:   <os>
Apr 14 12:31:44 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:31:44 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:31:44 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:31:44 user nova-compute[71330]:   </os>
Apr 14 12:31:44 user nova-compute[71330]:   <features>
Apr 14 12:31:44 user nova-compute[71330]:     <acpi/>
Apr 14 12:31:44 user nova-compute[71330]:     <apic/>
Apr 14 12:31:44 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:31:44 user nova-compute[71330]:   </features>
Apr 14 12:31:44 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:31:44 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:31:44 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:31:44 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:31:44 user nova-compute[71330]:   </clock>
Apr 14 12:31:44 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:31:44 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:31:44 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:31:44 user nova-compute[71330]:   </cpu>
Apr 14 12:31:44 user nova-compute[71330]:   <devices>
Apr 14 12:31:44 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:31:44 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:31:44 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk"/>
Apr 14 12:31:44 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:31:44 user nova-compute[71330]:     </disk>
Apr 14 12:31:44 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:31:44 user nova-compute[71330]:       <mac address="fa:16:3e:e4:ac:01"/>
Apr 14 12:31:44 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:31:44 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:31:44 user nova-compute[71330]:       <target dev="tapee784ad2-ee"/>
Apr 14 12:31:44 user nova-compute[71330]:     </interface>
Apr 14 12:31:44 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:31:44 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/console.log" append="off"/>
Apr 14 12:31:44 user nova-compute[71330]:     </serial>
Apr 14 12:31:44 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:31:44 user nova-compute[71330]:     <video>
Apr 14 12:31:44 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:31:44 user nova-compute[71330]:     </video>
Apr 14 12:31:44 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:31:44 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:31:44 user nova-compute[71330]:     </rng>
Apr 14 12:31:44 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:31:44 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:31:44 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:31:44 user nova-compute[71330]:     </memballoon>
Apr 14 12:31:44 user nova-compute[71330]:   </devices>
Apr 14 12:31:44 user nova-compute[71330]: </domain>
Apr 14 12:31:44 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-832590332',display_name='tempest-AttachVolumeNegativeTest-server-832590332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-832590332',id=46,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2n5YSC8QMWr5ck/++fyFR/Fek+st2PLAyRrIwipvxs2xnAN6MraEIVp9207YHntKSVZ9PMpam6j0695iHSPTsBnHlLA/TzEiQ0thDtndaSKOfJf6+r+dyJvHmFdggZOA==',key_name='tempest-keypair-1226525242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-cyrj2jir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=e52b7ccd-2e66-4579-bcdf-3059dfac872e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ac:01,bridge_name='br-int',has_traffic_filtering=True,id=ee784ad2-eed9-4260-8453-ec383447cf95,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee784ad2-ee') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG os_vif [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ac:01,bridge_name='br-int',has_traffic_filtering=True,id=ee784ad2-eed9-4260-8453-ec383447cf95,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee784ad2-ee') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee784ad2-ee, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee784ad2-ee, col_values=(('external_ids', {'iface-id': 'ee784ad2-eed9-4260-8453-ec383447cf95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:ac:01', 'vm-uuid': 'e52b7ccd-2e66-4579-bcdf-3059dfac872e'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:44 user nova-compute[71330]: INFO os_vif [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ac:01,bridge_name='br-int',has_traffic_filtering=True,id=ee784ad2-eed9-4260-8453-ec383447cf95,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee784ad2-ee')
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No VIF found with MAC fa:16:3e:e4:ac:01, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.network.neutron [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updated VIF entry in instance network info cache for port ee784ad2-eed9-4260-8453-ec383447cf95. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG nova.network.neutron [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updating instance_info_cache with network_info: [{"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:31:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] Releasing lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG nova.compute.manager [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received event network-vif-plugged-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG nova.compute.manager [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] No waiting events found dispatching network-vif-plugged-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:31:45 user nova-compute[71330]: WARNING nova.compute.manager [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received unexpected event network-vif-plugged-ee784ad2-eed9-4260-8453-ec383447cf95 for instance with vm_state building and task_state spawning.
Apr 14 12:31:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:45 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475507.4955027, e52b7ccd-2e66-4579-bcdf-3059dfac872e => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:31:47 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] VM Resumed (Lifecycle Event)
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:31:47 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Instance spawned successfully.
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:31:47 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475507.49674, e52b7ccd-2e66-4579-bcdf-3059dfac872e => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:31:47 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] VM Started (Lifecycle Event)
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:31:47 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:31:47 user nova-compute[71330]: INFO nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Took 5.40 seconds to spawn the instance on the hypervisor.
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received event network-vif-plugged-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:47 user nova-compute[71330]: DEBUG nova.compute.manager [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] No waiting events found dispatching network-vif-plugged-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:31:47 user nova-compute[71330]: WARNING nova.compute.manager [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received unexpected event network-vif-plugged-ee784ad2-eed9-4260-8453-ec383447cf95 for instance with vm_state building and task_state spawning.
Apr 14 12:31:47 user nova-compute[71330]: INFO nova.compute.manager [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Took 5.92 seconds to build instance.
Apr 14 12:31:47 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.006s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:31:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:31:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:32:00 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:03 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:32:03 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:32:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:32:03 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:32:03 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:32:03 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:32:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:04 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updating instance_info_cache with network_info: [{"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:32:04 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:32:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:32:04 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:32:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:11 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:32:15 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:32:17 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:32:18 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:32:18 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:32:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=26.200214385986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:32:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:32:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:22 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:32:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Verify base images {{(pid=71330) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Image id a84e226d-f438-4fb3-96fe-51f5960a6c87 yields fingerprint 641567286da12fd5e90c75259df826bb5f175b2e {{(pid=71330) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] image a84e226d-f438-4fb3-96fe-51f5960a6c87 at (/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e): checking
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] image a84e226d-f438-4fb3-96fe-51f5960a6c87 at (/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e): image is in use {{(pid=71330) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71330) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] e52b7ccd-2e66-4579-bcdf-3059dfac872e is a valid instance name {{(pid=71330) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] e52b7ccd-2e66-4579-bcdf-3059dfac872e has a disk file {{(pid=71330) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e is backed by 641567286da12fd5e90c75259df826bb5f175b2e {{(pid=71330) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 14 12:32:34 user nova-compute[71330]: WARNING nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Unknown base file: /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc
Apr 14 12:32:34 user nova-compute[71330]: WARNING nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Unknown base file: /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518
Apr 14 12:32:34 user nova-compute[71330]: WARNING nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389
Apr 14 12:32:34 user nova-compute[71330]: WARNING nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Unknown base file: /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6
Apr 14 12:32:34 user nova-compute[71330]: WARNING nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51
Apr 14 12:32:34 user nova-compute[71330]: WARNING nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Unknown base file: /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2
Apr 14 12:32:34 user nova-compute[71330]: WARNING nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Unknown base file: /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425
Apr 14 12:32:34 user nova-compute[71330]: WARNING nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Unknown base file: /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce
Apr 14 12:32:34 user nova-compute[71330]: WARNING nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Unknown base file: /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Active base files: /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Removable base files: /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518 /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389 /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6 /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51 /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2 /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425 /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/88a9e9186f19d16a0cd74ec9537f2b852e07b2bc
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f63d351389b409ff33e2436805b24bf043db0518
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d26789fb9d41283d19eaa0472899ccd9afbe389
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e4c01c1de309cc998394e6847600e93178e8c9f6
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f07ecf7af10e0a9de0d07a8cd9ae2434a558e51
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cf6c2f3f7fc528ccc17b24dcae63acac335a38b2
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7ca110ff5bf6ae8d76397b8f87c283136829a425
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bbbb7e6250328c8fbb6efbe4973900531e7386ce
Apr 14 12:32:34 user nova-compute[71330]: INFO nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a3819dc5e4cf1dd274af81d3d29e7ed3d3492ef4
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Verification complete {{(pid=71330) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Verify swap images {{(pid=71330) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 14 12:32:34 user nova-compute[71330]: DEBUG nova.virt.libvirt.imagecache [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Verify ephemeral images {{(pid=71330) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 14 12:32:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:32:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:32:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:32:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:32:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:32:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:33:04 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:33:04 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:33:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:33:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:33:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:33:05 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:33:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updating instance_info_cache with network_info: [{"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:33:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:33:05 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:33:05 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:33:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:11 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 12:33:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] There are 0 instances to clean {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 12:33:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:33:18 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:18 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:33:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:33:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:33:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:33:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:19 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:33:19 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=26.199588775634766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing inventories for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating ProviderTree inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing aggregate associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, aggregates: None {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Refreshing trait associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:33:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:33:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:22 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:33:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received event network-changed-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:33:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Refreshing instance network info cache due to event network-changed-ee784ad2-eed9-4260-8453-ec383447cf95. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:33:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] Acquiring lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:33:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] Acquired lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:33:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Refreshing network info cache for port ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:33:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updated VIF entry in instance network info cache for port ee784ad2-eed9-4260-8453-ec383447cf95. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:33:33 user nova-compute[71330]: DEBUG nova.network.neutron [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updating instance_info_cache with network_info: [{"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:33:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] Releasing lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:33:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:36 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:36 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances with incomplete migration  {{(pid=71330) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 12:33:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:33:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:33:36 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'flavor' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:33:36 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:33:37 user nova-compute[71330]: INFO nova.compute.manager [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Attaching volume 4d612e95-affc-40f1-9374-b67a25700c70 to /dev/vdb
Apr 14 12:33:37 user nova-compute[71330]: DEBUG os_brick.utils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8f9170-f34f-47c5-8635-e5fbca2fee4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[78284e32-69f8-4437-b221-8573460556e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee879b10-d119-40a5-ab79-dad6540b25f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b0a3bb-1dcd-4795-a611-068cd13567ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:33:37 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:33:37 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad32b065-7521-494c-a9c4-1fa00c8e9c62]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG os_brick.utils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:33:37 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updating existing volume attachment record: 07bd4f8a-5dfa-4bae-b337-2629f43a50aa {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:33:39 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:39 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:33:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnRgriQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:33:41 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:33:41 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:33:41 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63d4742-b78f-4ffe-85cf-516c3c2324e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:33:41 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ac2b30-0113-4a1c-8423-850fa62ac3fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70] added
Apr 14 12:33:41 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5eddc2-e2cb-4a33-99b2-83cb907132e7]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[769d17d2-e4bb-4ebc-9d25-c73ae452d2ba]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnRgriQy {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnRgriQy" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2ca74f-1a9d-4f46-82de-5627c33607c5]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XnRgriQy'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f936e123-3d2d-4200-afb3-60fe3e2780bc]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ac1008-4707-40bf-9d8b-e2b9cf5c1bd1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 12:33:41 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 12:33:41 user nova-compute[71330]:  {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:33:41 user nova-compute[71330]: WARNING os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 12:33:41 user nova-compute[71330]: 
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e2613f-92a7-40e9-951f-a384cce291ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70, portal: 172.16.0.220,3260]
Apr 14 12:33:41 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70, portal: 172.16.0.220,3260] successful.
Apr 14 12:33:41 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd0b73a-b31e-485d-a788-012b0c2bba0c]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2c7a7d-20bc-424e-bb1e-bc813abba2d6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 (non-flash)
Apr 14 12:33:41 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 (non-flash)
Apr 14 12:33:41 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[0428eccc-33f4-4531-98e5-cb5f9dc96656]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:41 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:33:42 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:33:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnRgriQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:33:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:33:42 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23365316437616466', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:33:42 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365316437616466', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:33:42 user nova-compute[71330]: DEBUG nova.objects.instance [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'flavor' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:33:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:33:43 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:33:43 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:33:43 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:33:43 user nova-compute[71330]:   <serial>4d612e95-affc-40f1-9374-b67a25700c70</serial>
Apr 14 12:33:43 user nova-compute[71330]: </disk>
Apr 14 12:33:43 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:33:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:33:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:33:43 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No VIF found with MAC fa:16:3e:e4:ac:01, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:33:43 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.556s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:33:44 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:33:44 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:33:45 user nova-compute[71330]: INFO nova.compute.manager [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Detaching volume 4d612e95-affc-40f1-9374-b67a25700c70
Apr 14 12:33:45 user nova-compute[71330]: INFO nova.virt.block_device [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Attempting to driver detach volume 4d612e95-affc-40f1-9374-b67a25700c70 from mountpoint /dev/vdb
Apr 14 12:33:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Attempting to detach device vdb from instance e52b7ccd-2e66-4579-bcdf-3059dfac872e from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:33:45 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:33:45 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:33:45 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:33:45 user nova-compute[71330]:   <serial>4d612e95-affc-40f1-9374-b67a25700c70</serial>
Apr 14 12:33:45 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:33:45 user nova-compute[71330]: </disk>
Apr 14 12:33:45 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:33:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully detached device vdb from instance e52b7ccd-2e66-4579-bcdf-3059dfac872e from the persistent domain config.
Apr 14 12:33:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e52b7ccd-2e66-4579-bcdf-3059dfac872e from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:33:45 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:33:45 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:33:45 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:33:45 user nova-compute[71330]:   <serial>4d612e95-affc-40f1-9374-b67a25700c70</serial>
Apr 14 12:33:45 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:33:45 user nova-compute[71330]: </disk>
Apr 14 12:33:45 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681475625.4587848, e52b7ccd-2e66-4579-bcdf-3059dfac872e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:33:45 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully detached device vdb from instance e52b7ccd-2e66-4579-bcdf-3059dfac872e from the live domain config.
Apr 14 12:33:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnRgriQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:33:45 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d999359-3533-4307-afc8-a3f5fef9a26e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:33:45 user nova-compute[71330]: No targets found.
Apr 14 12:33:45 user nova-compute[71330]: iSNS:
Apr 14 12:33:45 user nova-compute[71330]: No targets found.
Apr 14 12:33:45 user nova-compute[71330]: STATIC:
Apr 14 12:33:45 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70
Apr 14 12:33:45 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:33:45 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:33:45 user nova-compute[71330]: FIRMWARE:
Apr 14 12:33:45 user nova-compute[71330]: No targets found.
Apr 14 12:33:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:33:45 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:33:45 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1ba94e-266d-4ae3-b2f2-7b3e1495f8bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec60c19-5f91-4246-aba9-8374fe9cd625]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 (non-flash)
Apr 14 12:33:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 (non-flash)
Apr 14 12:33:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49605649d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d089fd29-9723-47ff-8836-75da3506bf02]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[679df7c7-1579-49a8-85f8-ef2f99c4a1bc]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[7436b613-4be8-47fd-9339-2f699e4a5bb0]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14a8d9-7e2a-4950-bf69-704f1e1966b5]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adca880-79d4-4900-9438-51d4215f17d3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7c2d45-c984-4a86-9101-fe1c148595c4]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70, portal: 172.16.0.220,3260]
Apr 14 12:33:45 user nova-compute[71330]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70, portal: 172.16.0.220,3260] successful.
Apr 14 12:33:45 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d612e95-affc-40f1-9374-b67a25700c70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba826e45-b3e1-4cc4-98e7-cd3975947b62]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] <== disconnect_volume: return (324ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:33:45 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:33:46 user nova-compute[71330]: DEBUG nova.objects.instance [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'flavor' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:33:46 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:33:49 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:54 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:33:59 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:34:04 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:34:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:05 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:05 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:34:05 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:34:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:34:05 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:34:05 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:34:05 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:34:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updating instance_info_cache with network_info: [{"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:34:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-e52b7ccd-2e66-4579-bcdf-3059dfac872e" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:34:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:34:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:09 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:34:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:14 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:18 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:34:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:34:18 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:34:18 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:34:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:34:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:34:18 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:34:19 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:34:19 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:34:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=26.19849395751953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:34:19 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:34:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:21 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_power_states {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:21 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Triggering sync for uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 12:34:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:34:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:34:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:34:24 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:34:24 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:34:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:34:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:34:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:34:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:34:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:34:29 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:34 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:34:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Terminating instance
Apr 14 12:34:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received event network-vif-unplugged-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] No waiting events found dispatching network-vif-unplugged-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:34:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received event network-vif-unplugged-ee784ad2-eed9-4260-8453-ec383447cf95 for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Instance destroyed successfully.
Apr 14 12:34:36 user nova-compute[71330]: DEBUG nova.objects.instance [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'resources' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-832590332',display_name='tempest-AttachVolumeNegativeTest-server-832590332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-832590332',id=46,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2n5YSC8QMWr5ck/++fyFR/Fek+st2PLAyRrIwipvxs2xnAN6MraEIVp9207YHntKSVZ9PMpam6j0695iHSPTsBnHlLA/TzEiQ0thDtndaSKOfJf6+r+dyJvHmFdggZOA==',key_name='tempest-keypair-1226525242',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:31:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-cyrj2jir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:31:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=e52b7ccd-2e66-4579-bcdf-3059dfac872e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "ee784ad2-eed9-4260-8453-ec383447cf95", "address": "fa:16:3e:e4:ac:01", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee784ad2-ee", "ovs_interfaceid": "ee784ad2-eed9-4260-8453-ec383447cf95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:ac:01,bridge_name='br-int',has_traffic_filtering=True,id=ee784ad2-eed9-4260-8453-ec383447cf95,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee784ad2-ee') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG os_vif [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:ac:01,bridge_name='br-int',has_traffic_filtering=True,id=ee784ad2-eed9-4260-8453-ec383447cf95,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee784ad2-ee') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee784ad2-ee, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:34:36 user nova-compute[71330]: INFO os_vif [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:ac:01,bridge_name='br-int',has_traffic_filtering=True,id=ee784ad2-eed9-4260-8453-ec383447cf95,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee784ad2-ee')
Apr 14 12:34:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Deleting instance files /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e_del
Apr 14 12:34:36 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Deletion of /opt/stack/data/nova/instances/e52b7ccd-2e66-4579-bcdf-3059dfac872e_del complete
Apr 14 12:34:36 user nova-compute[71330]: INFO nova.compute.manager [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 14 12:34:36 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:34:36 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:34:37 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Took 1.16 seconds to deallocate network for instance.
Apr 14 12:34:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-ff220a13-278b-4525-9df7-6c1078b0cec3 req-02d3e012-4733-4d2d-89f1-6a1d0e9913ee service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received event network-vif-deleted-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:34:37 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Deleted allocations for instance e52b7ccd-2e66-4579-bcdf-3059dfac872e
Apr 14 12:34:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.426s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received event network-vif-plugged-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] Acquiring lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] Lock "e52b7ccd-2e66-4579-bcdf-3059dfac872e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:34:37 user nova-compute[71330]: DEBUG nova.compute.manager [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] No waiting events found dispatching network-vif-plugged-ee784ad2-eed9-4260-8453-ec383447cf95 {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:34:37 user nova-compute[71330]: WARNING nova.compute.manager [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Received unexpected event network-vif-plugged-ee784ad2-eed9-4260-8453-ec383447cf95 for instance with vm_state deleted and task_state None.
Apr 14 12:34:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:51 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475676.318302, e52b7ccd-2e66-4579-bcdf-3059dfac872e => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:34:51 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] VM Stopped (Lifecycle Event)
Apr 14 12:34:51 user nova-compute[71330]: DEBUG nova.compute.manager [None req-b6650ea3-4eb3-469d-8cdc-0318d70f4214 None None] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:34:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:34:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:35:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:35:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:35:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 12:35:07 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:10 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:35:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:11 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:35:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:35:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:35:20 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:35:21 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:35:21 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:35:21 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=26.217552185058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:35:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:35:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:35:21 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:35:21 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:35:21 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:35:21 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:35:21 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:35:21 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:35:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:22 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:24 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:35:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:35:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:35:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:35:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:35:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Starting instance... {{(pid=71330) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71330) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 12:35:29 user nova-compute[71330]: INFO nova.compute.claims [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Claim successful on node user
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Start building networks asynchronously for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Allocating IP information in the background. {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.network.neutron [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] allocate_for_instance() {{(pid=71330) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 12:35:29 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Start building block device mappings for instance. {{(pid=71330) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.policy [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71330) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Start spawning the instance on the hypervisor. {{(pid=71330) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Creating instance directory {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 12:35:29 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Creating image(s)
Apr 14 12:35:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "/opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "/opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:35:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.134s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "641567286da12fd5e90c75259df826bb5f175b2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.133s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk 1073741824 {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e,backing_fmt=raw /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk 1073741824" returned: 0 in 0.048s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "641567286da12fd5e90c75259df826bb5f175b2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/641567286da12fd5e90c75259df826bb5f175b2e --force-share --output=json" returned: 0 in 0.138s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk. size=1073741824 {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG nova.virt.disk.api [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Cannot resize image /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk to a smaller size. {{(pid=71330) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG nova.objects.instance [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'migration_context' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Created local disks {{(pid=71330) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Ensure instance console log exists: /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/console.log {{(pid=71330) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:35:30 user nova-compute[71330]: DEBUG nova.network.neutron [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Successfully created port: 985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Successfully updated port: 985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquired lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Building network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received event network-changed-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.compute.manager [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Refreshing instance network info cache due to event network-changed-985d0774-abf7-42c9-8495-5fdfa488641b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] Acquiring lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Instance cache missing network info. {{(pid=71330) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.network.neutron [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updating instance_info_cache with network_info: [{"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Releasing lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Instance network_info: |[{"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71330) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] Acquired lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.network.neutron [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Refreshing network info cache for port 985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Start _get_guest_xml network_info=[{"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a84e226d-f438-4fb3-96fe-51f5960a6c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 12:35:31 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:35:31 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71330) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T11:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:53:02Z,direct_url=<?>,disk_format='qcow2',id=a84e226d-f438-4fb3-96fe-51f5960a6c87,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2e49c46dbecd4dc3a7c692a647bc7832',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:53:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image limits 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image pref 0:0:0 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Got 1 possible topologies {{(pid=71330) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71330) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-176094221',display_name='tempest-AttachVolumeNegativeTest-server-176094221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-176094221',id=47,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgBt3aXEPux5x/euTPC70vUHsoPtPoWG2MGNlDSeYEqAvM9YUZyQaSt238vYpgnPmWTlfuVMYnPw8Z4ngWNZoWBlflp/CB0g8UzRZyRjFXHa3SvF7GenI77OnMqTAGAew==',key_name='tempest-keypair-509267361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-paeiddn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=1f55e425-e53d-4649-a068-752a764c5629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71330) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:93:84,bridge_name='br-int',has_traffic_filtering=True,id=985d0774-abf7-42c9-8495-5fdfa488641b,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985d0774-ab') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.objects.instance [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] End _get_guest_xml xml=<domain type="kvm">
Apr 14 12:35:31 user nova-compute[71330]:   <uuid>1f55e425-e53d-4649-a068-752a764c5629</uuid>
Apr 14 12:35:31 user nova-compute[71330]:   <name>instance-0000002f</name>
Apr 14 12:35:31 user nova-compute[71330]:   <memory>131072</memory>
Apr 14 12:35:31 user nova-compute[71330]:   <vcpu>1</vcpu>
Apr 14 12:35:31 user nova-compute[71330]:   <metadata>
Apr 14 12:35:31 user nova-compute[71330]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 12:35:31 user nova-compute[71330]:       <nova:package version="0.0.0"/>
Apr 14 12:35:31 user nova-compute[71330]:       <nova:name>tempest-AttachVolumeNegativeTest-server-176094221</nova:name>
Apr 14 12:35:31 user nova-compute[71330]:       <nova:creationTime>2023-04-14 12:35:31</nova:creationTime>
Apr 14 12:35:31 user nova-compute[71330]:       <nova:flavor name="m1.nano">
Apr 14 12:35:31 user nova-compute[71330]:         <nova:memory>128</nova:memory>
Apr 14 12:35:31 user nova-compute[71330]:         <nova:disk>1</nova:disk>
Apr 14 12:35:31 user nova-compute[71330]:         <nova:swap>0</nova:swap>
Apr 14 12:35:31 user nova-compute[71330]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 12:35:31 user nova-compute[71330]:         <nova:vcpus>1</nova:vcpus>
Apr 14 12:35:31 user nova-compute[71330]:       </nova:flavor>
Apr 14 12:35:31 user nova-compute[71330]:       <nova:owner>
Apr 14 12:35:31 user nova-compute[71330]:         <nova:user uuid="609f2fce20c44000903c8a05e07ebd67">tempest-AttachVolumeNegativeTest-1138909145-project-member</nova:user>
Apr 14 12:35:31 user nova-compute[71330]:         <nova:project uuid="fa90860f65ab408aa00dfd6abb8af18b">tempest-AttachVolumeNegativeTest-1138909145</nova:project>
Apr 14 12:35:31 user nova-compute[71330]:       </nova:owner>
Apr 14 12:35:31 user nova-compute[71330]:       <nova:root type="image" uuid="a84e226d-f438-4fb3-96fe-51f5960a6c87"/>
Apr 14 12:35:31 user nova-compute[71330]:       <nova:ports>
Apr 14 12:35:31 user nova-compute[71330]:         <nova:port uuid="985d0774-abf7-42c9-8495-5fdfa488641b">
Apr 14 12:35:31 user nova-compute[71330]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 12:35:31 user nova-compute[71330]:         </nova:port>
Apr 14 12:35:31 user nova-compute[71330]:       </nova:ports>
Apr 14 12:35:31 user nova-compute[71330]:     </nova:instance>
Apr 14 12:35:31 user nova-compute[71330]:   </metadata>
Apr 14 12:35:31 user nova-compute[71330]:   <sysinfo type="smbios">
Apr 14 12:35:31 user nova-compute[71330]:     <system>
Apr 14 12:35:31 user nova-compute[71330]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 12:35:31 user nova-compute[71330]:       <entry name="product">OpenStack Nova</entry>
Apr 14 12:35:31 user nova-compute[71330]:       <entry name="version">0.0.0</entry>
Apr 14 12:35:31 user nova-compute[71330]:       <entry name="serial">1f55e425-e53d-4649-a068-752a764c5629</entry>
Apr 14 12:35:31 user nova-compute[71330]:       <entry name="uuid">1f55e425-e53d-4649-a068-752a764c5629</entry>
Apr 14 12:35:31 user nova-compute[71330]:       <entry name="family">Virtual Machine</entry>
Apr 14 12:35:31 user nova-compute[71330]:     </system>
Apr 14 12:35:31 user nova-compute[71330]:   </sysinfo>
Apr 14 12:35:31 user nova-compute[71330]:   <os>
Apr 14 12:35:31 user nova-compute[71330]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 12:35:31 user nova-compute[71330]:     <boot dev="hd"/>
Apr 14 12:35:31 user nova-compute[71330]:     <smbios mode="sysinfo"/>
Apr 14 12:35:31 user nova-compute[71330]:   </os>
Apr 14 12:35:31 user nova-compute[71330]:   <features>
Apr 14 12:35:31 user nova-compute[71330]:     <acpi/>
Apr 14 12:35:31 user nova-compute[71330]:     <apic/>
Apr 14 12:35:31 user nova-compute[71330]:     <vmcoreinfo/>
Apr 14 12:35:31 user nova-compute[71330]:   </features>
Apr 14 12:35:31 user nova-compute[71330]:   <clock offset="utc">
Apr 14 12:35:31 user nova-compute[71330]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 12:35:31 user nova-compute[71330]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 12:35:31 user nova-compute[71330]:     <timer name="hpet" present="no"/>
Apr 14 12:35:31 user nova-compute[71330]:   </clock>
Apr 14 12:35:31 user nova-compute[71330]:   <cpu mode="custom" match="exact">
Apr 14 12:35:31 user nova-compute[71330]:     <model>Nehalem</model>
Apr 14 12:35:31 user nova-compute[71330]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 12:35:31 user nova-compute[71330]:   </cpu>
Apr 14 12:35:31 user nova-compute[71330]:   <devices>
Apr 14 12:35:31 user nova-compute[71330]:     <disk type="file" device="disk">
Apr 14 12:35:31 user nova-compute[71330]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 12:35:31 user nova-compute[71330]:       <source file="/opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk"/>
Apr 14 12:35:31 user nova-compute[71330]:       <target dev="vda" bus="virtio"/>
Apr 14 12:35:31 user nova-compute[71330]:     </disk>
Apr 14 12:35:31 user nova-compute[71330]:     <interface type="ethernet">
Apr 14 12:35:31 user nova-compute[71330]:       <mac address="fa:16:3e:d8:93:84"/>
Apr 14 12:35:31 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:35:31 user nova-compute[71330]:       <mtu size="1442"/>
Apr 14 12:35:31 user nova-compute[71330]:       <target dev="tap985d0774-ab"/>
Apr 14 12:35:31 user nova-compute[71330]:     </interface>
Apr 14 12:35:31 user nova-compute[71330]:     <serial type="pty">
Apr 14 12:35:31 user nova-compute[71330]:       <log file="/opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/console.log" append="off"/>
Apr 14 12:35:31 user nova-compute[71330]:     </serial>
Apr 14 12:35:31 user nova-compute[71330]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 12:35:31 user nova-compute[71330]:     <video>
Apr 14 12:35:31 user nova-compute[71330]:       <model type="virtio"/>
Apr 14 12:35:31 user nova-compute[71330]:     </video>
Apr 14 12:35:31 user nova-compute[71330]:     <rng model="virtio">
Apr 14 12:35:31 user nova-compute[71330]:       <backend model="random">/dev/urandom</backend>
Apr 14 12:35:31 user nova-compute[71330]:     </rng>
Apr 14 12:35:31 user nova-compute[71330]:     <controller type="usb" index="0" model="none"/>
Apr 14 12:35:31 user nova-compute[71330]:     <memballoon model="virtio">
Apr 14 12:35:31 user nova-compute[71330]:       <stats period="10"/>
Apr 14 12:35:31 user nova-compute[71330]:     </memballoon>
Apr 14 12:35:31 user nova-compute[71330]:   </devices>
Apr 14 12:35:31 user nova-compute[71330]: </domain>
Apr 14 12:35:31 user nova-compute[71330]:  {{(pid=71330) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-176094221',display_name='tempest-AttachVolumeNegativeTest-server-176094221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-176094221',id=47,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgBt3aXEPux5x/euTPC70vUHsoPtPoWG2MGNlDSeYEqAvM9YUZyQaSt238vYpgnPmWTlfuVMYnPw8Z4ngWNZoWBlflp/CB0g8UzRZyRjFXHa3SvF7GenI77OnMqTAGAew==',key_name='tempest-keypair-509267361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-paeiddn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T12:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=1f55e425-e53d-4649-a068-752a764c5629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:93:84,bridge_name='br-int',has_traffic_filtering=True,id=985d0774-abf7-42c9-8495-5fdfa488641b,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985d0774-ab') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG os_vif [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:93:84,bridge_name='br-int',has_traffic_filtering=True,id=985d0774-abf7-42c9-8495-5fdfa488641b,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985d0774-ab') {{(pid=71330) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap985d0774-ab, may_exist=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap985d0774-ab, col_values=(('external_ids', {'iface-id': '985d0774-abf7-42c9-8495-5fdfa488641b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:93:84', 'vm-uuid': '1f55e425-e53d-4649-a068-752a764c5629'}),)) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:31 user nova-compute[71330]: INFO os_vif [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:93:84,bridge_name='br-int',has_traffic_filtering=True,id=985d0774-abf7-42c9-8495-5fdfa488641b,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985d0774-ab')
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:35:31 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No VIF found with MAC fa:16:3e:d8:93:84, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:35:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updated VIF entry in instance network info cache for port 985d0774-abf7-42c9-8495-5fdfa488641b. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:35:32 user nova-compute[71330]: DEBUG nova.network.neutron [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updating instance_info_cache with network_info: [{"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:35:32 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] Releasing lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received event network-vif-plugged-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG nova.compute.manager [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] No waiting events found dispatching network-vif-plugged-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:35:33 user nova-compute[71330]: WARNING nova.compute.manager [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received unexpected event network-vif-plugged-985d0774-abf7-42c9-8495-5fdfa488641b for instance with vm_state building and task_state spawning.
Apr 14 12:35:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received event network-vif-plugged-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.compute.manager [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] No waiting events found dispatching network-vif-plugged-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:35:35 user nova-compute[71330]: WARNING nova.compute.manager [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received unexpected event network-vif-plugged-985d0774-abf7-42c9-8495-5fdfa488641b for instance with vm_state building and task_state spawning.
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475735.4711313, 1f55e425-e53d-4649-a068-752a764c5629 => Resumed> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:35:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] VM Resumed (Lifecycle Event)
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Instance event wait completed in 0 seconds for  {{(pid=71330) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Guest created on hypervisor {{(pid=71330) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 12:35:35 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Instance spawned successfully.
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Found default for hw_cdrom_bus of ide {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Found default for hw_disk_bus of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Found default for hw_input_bus of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Found default for hw_pointer_model of None {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Found default for hw_video_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Found default for hw_vif_model of virtio {{(pid=71330) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 12:35:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.virt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Emitting event <LifecycleEvent: 1681475735.473022, 1f55e425-e53d-4649-a068-752a764c5629 => Started> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:35:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] VM Started (Lifecycle Event)
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71330) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 12:35:35 user nova-compute[71330]: INFO nova.compute.manager [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 12:35:35 user nova-compute[71330]: INFO nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Took 5.69 seconds to spawn the instance on the hypervisor.
Apr 14 12:35:35 user nova-compute[71330]: DEBUG nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:35:35 user nova-compute[71330]: INFO nova.compute.manager [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Took 6.22 seconds to build instance.
Apr 14 12:35:35 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.326s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:35:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:40 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:35:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:35:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:36:05 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:06 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:36:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:36:06 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:36:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:36:06 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:36:06 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:36:06 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:36:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:07 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updating instance_info_cache with network_info: [{"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:36:07 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:36:07 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:36:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:36:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:36:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:36:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:36:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:36:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:36:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:36:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:36:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:36:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:20 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:36:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:22 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:36:22 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:36:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:36:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:36:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:36:22 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:36:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:36:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:36:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:36:23 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:36:23 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:36:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=26.19599151611328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1f55e425-e53d-4649-a068-752a764c5629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:36:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:36:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:36:27 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:36:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:36:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:36:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:36:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:36:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:36:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:36:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:50 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:36:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:36:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:36:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:36:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:36:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:37:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:37:08 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:08 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:37:08 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:37:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:37:08 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:37:08 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:37:08 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:37:09 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updating instance_info_cache with network_info: [{"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:37:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:37:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:37:10 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:11 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:37:13 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:13 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:37:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:16 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:37:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received event network-changed-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:37:20 user nova-compute[71330]: DEBUG nova.compute.manager [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Refreshing instance network info cache due to event network-changed-985d0774-abf7-42c9-8495-5fdfa488641b. {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 12:37:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] Acquiring lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:37:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] Acquired lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:37:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Refreshing network info cache for port 985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 12:37:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updated VIF entry in instance network info cache for port 985d0774-abf7-42c9-8495-5fdfa488641b. {{(pid=71330) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 12:37:20 user nova-compute[71330]: DEBUG nova.network.neutron [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updating instance_info_cache with network_info: [{"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:37:20 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] Releasing lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:37:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:37:22 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:37:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:37:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:37:22 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:37:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:22 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:23 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:37:23 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:37:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=26.1953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Instance 1f55e425-e53d-4649-a068-752a764c5629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71330) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:37:23 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'flavor' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:37:24 user nova-compute[71330]: INFO nova.compute.manager [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Attaching volume 2419b52f-f8fb-4463-ad08-ae41af67611b to /dev/vdb
Apr 14 12:37:24 user nova-compute[71330]: DEBUG os_brick.utils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13f765f-6788-4057-9b77-5f38d0de64ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f54e6e9ec3f\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[df790a8e-01e3-479d-9bfb-11dead83826a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73ff36c-5049-42f3-a7fd-6195d1bae391]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e692a0f-a950-4ce4-ae26-ec02df65517b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Running cmd (subprocess): nvme version {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 'nvme version' failed. Not Retrying. {{(pid=71330) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] nvme not present on system {{(pid=71330) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 12:37:24 user nova-compute[71330]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[1255a11b-f814-4c5e-9615-6bc5b0c1c37a]: (4, '') {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71330) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] LIGHTOS: no hostnqn found. {{(pid=71330) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG os_brick.utils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f54e6e9ec3f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG nova.virt.block_device [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updating existing volume attachment record: 1e0e4e20-e7ec-4dad-97f5-4f7723dcfc24 {{(pid=71330) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 12:37:24 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:26 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:27 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Calling os-brick to attach iSCSI Volume {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmnJGqDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:37:28 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:37:28 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:37:28 user nova-compute[71330]: INFO os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[05be1fd6-65b6-4c3d-a8a6-d3ff89a7a40f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 12:37:28 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --interface default --op new {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[771202df-aefd-42bb-81c0-4193610ba62f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b] added\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b] added
Apr 14 12:37:28 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[f481a398-17d4-42d7-9fe8-43e50e45dac3]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b8fa83-e029-44bc-95cb-deb714b52b0a]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmnJGqDS {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmnJGqDS" returned: 0 in 0.017s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f5afa-b675-49e6-ad87-99faf26c09db]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QmnJGqDS'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:28 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a35e2fa-595d-418e-8b3a-649ae4a7f166]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac12d226-9ae3-41c3-bd62-638703422104]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 12:37:29 user nova-compute[71330]:  {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 12:37:29 user nova-compute[71330]:  {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:37:29 user nova-compute[71330]: WARNING os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 12:37:29 user nova-compute[71330]: 
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --login {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b5280b-b940-4335-8f6c-ae7d0b95d1cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b, portal: 172.16.0.220,3260]
Apr 14 12:37:29 user nova-compute[71330]: Login to [iface: default, target: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b, portal: 172.16.0.220,3260] successful.
Apr 14 12:37:29 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.047s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[e634becb-bfb6-42ce-9fdb-8d217372e2fb]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[542ef96e-edd2-43fd-ac83-59fc0c09f835]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b (non-flash)
Apr 14 12:37:29 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b (non-flash)
Apr 14 12:37:29 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Connected to 172.16.0.220:3260 {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71330) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71330) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e3f96b-15ff-423b-b2a3-41ad694fec9d]: (4, ('- - 0', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71330) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 12:37:29 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmnJGqDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71330) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26165643837333161', 'path': '/dev/sdb'} {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165643837333161', 'path': '/dev/sdb'} {{(pid=71330) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG nova.objects.instance [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'flavor' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 12:37:30 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:37:30 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:37:30 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:37:30 user nova-compute[71330]:   <serial>2419b52f-f8fb-4463-ad08-ae41af67611b</serial>
Apr 14 12:37:30 user nova-compute[71330]: </disk>
Apr 14 12:37:30 user nova-compute[71330]:  {{(pid=71330) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71330) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] No VIF found with MAC fa:16:3e:d8:93:84, not building metadata {{(pid=71330) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 12:37:30 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.605s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:37:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:37:31 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:37:32 user nova-compute[71330]: INFO nova.compute.manager [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Detaching volume 2419b52f-f8fb-4463-ad08-ae41af67611b
Apr 14 12:37:32 user nova-compute[71330]: INFO nova.virt.block_device [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Attempting to driver detach volume 2419b52f-f8fb-4463-ad08-ae41af67611b from mountpoint /dev/vdb
Apr 14 12:37:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Attempting to detach device vdb from instance 1f55e425-e53d-4649-a068-752a764c5629 from the persistent domain config. {{(pid=71330) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:37:32 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:37:32 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:37:32 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:37:32 user nova-compute[71330]:   <serial>2419b52f-f8fb-4463-ad08-ae41af67611b</serial>
Apr 14 12:37:32 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:37:32 user nova-compute[71330]: </disk>
Apr 14 12:37:32 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:37:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully detached device vdb from instance 1f55e425-e53d-4649-a068-752a764c5629 from the persistent domain config.
Apr 14 12:37:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f55e425-e53d-4649-a068-752a764c5629 from the live domain config. {{(pid=71330) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.guest [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 12:37:32 user nova-compute[71330]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 12:37:32 user nova-compute[71330]:   <source dev="/dev/sdb"/>
Apr 14 12:37:32 user nova-compute[71330]:   <target dev="vdb" bus="virtio"/>
Apr 14 12:37:32 user nova-compute[71330]:   <serial>2419b52f-f8fb-4463-ad08-ae41af67611b</serial>
Apr 14 12:37:32 user nova-compute[71330]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 12:37:32 user nova-compute[71330]: </disk>
Apr 14 12:37:32 user nova-compute[71330]:  {{(pid=71330) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-1badbe61-26ea-45fa-8682-c75caaaff4ff None None] Received event <DeviceRemovedEvent: 1681475852.5388284, 1f55e425-e53d-4649-a068-752a764c5629 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71330) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.driver [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 12:37:32 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully detached device vdb from instance 1f55e425-e53d-4649-a068-752a764c5629 from the live domain config.
Apr 14 12:37:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] calling os-brick to detach iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49542f5000>, {'target_iqn': 'iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmnJGqDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 12:37:32 user nova-compute[71330]: WARNING os_brick.initiator.connectors.base [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7041fe-093b-4928-bb19-a6daf0e11f80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 12:37:32 user nova-compute[71330]: No targets found.
Apr 14 12:37:32 user nova-compute[71330]: iSNS:
Apr 14 12:37:32 user nova-compute[71330]: No targets found.
Apr 14 12:37:32 user nova-compute[71330]: STATIC:
Apr 14 12:37:32 user nova-compute[71330]: Target: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b
Apr 14 12:37:32 user nova-compute[71330]:         Portal: 172.16.0.220:3260,-1
Apr 14 12:37:32 user nova-compute[71330]:                 Iface Name: default
Apr 14 12:37:32 user nova-compute[71330]: FIRMWARE:
Apr 14 12:37:32 user nova-compute[71330]: No targets found.
Apr 14 12:37:32 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 12:37:32 user nova-compute[71330]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 12:37:32 user nova-compute[71330]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71330) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b', 0)] {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4bde74-ab5f-432e-89e9-daf917e00f7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedadc85-4d2f-4258-8bf4-893ac46284ad]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b (non-flash)\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b (non-flash)
Apr 14 12:37:32 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b (non-flash)
Apr 14 12:37:32 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f495d5364d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b'): ({'sdb'}, set())}) {{(pid=71330) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Removing single pathed devices sdb {{(pid=71330) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e364494-6e1a-4f03-874e-f519583804e0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6356c9d-04c1-4e76-b023-1c4435d3e4b7]: (4, ('ok\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flushing IO for device /dev/sdb {{(pid=71330) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[913e03bb-d844-4490-a564-fafbd4edde15]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71330) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[148359ac-8c16-4489-af82-831d573905e1]: (4, ('1', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.linuxscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] SCSI volumes sdb have been removed. {{(pid=71330) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b')] {{(pid=71330) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa02304-3a4c-4c6f-bec7-aa10f6b19315]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --logout {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaf5596-4148-495e-83c1-0ca95ca5804c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b, portal: 172.16.0.220,3260]
Apr 14 12:37:32 user nova-compute[71330]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b, portal: 172.16.0.220,3260] successful.
Apr 14 12:37:32 user nova-compute[71330]:  stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op delete {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2419b52f-f8fb-4463-ad08-ae41af67611b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82058) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG oslo.privsep.daemon [-] privsep: reply[13396708-a114-4e57-8a65-3853f6caef50]: (4, ('', '')) {{(pid=82058) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71330) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.base [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] <== disconnect_volume: return (298ms) None {{(pid=71330) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 12:37:32 user nova-compute[71330]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Disconnected iSCSI Volume {{(pid=71330) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 12:37:33 user nova-compute[71330]: DEBUG nova.objects.instance [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'flavor' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:37:33 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:37:35 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:36 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:41 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:37:46 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:37:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:37:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:37:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:37:51 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:55 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:37:56 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:01 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:38:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:38:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:38:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:38:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:38:06 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:09 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:38:09 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:38:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 12:38:09 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquired lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 12:38:09 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Forcefully refreshing network info cache for instance {{(pid=71330) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 12:38:09 user nova-compute[71330]: DEBUG nova.objects.instance [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lazy-loading 'info_cache' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:38:10 user nova-compute[71330]: DEBUG nova.network.neutron [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updating instance_info_cache with network_info: [{"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:38:10 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Releasing lock "refresh_cache-1f55e425-e53d-4649-a068-752a764c5629" {{(pid=71330) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 12:38:10 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updated the network info_cache for instance {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 12:38:11 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:14 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:14 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:38:15 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:16 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:17 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:18 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 12:38:18 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] There are 0 instances to clean {{(pid=71330) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 12:38:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:21 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:38:22 user nova-compute[71330]: INFO nova.compute.manager [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Terminating instance
Apr 14 12:38:22 user nova-compute[71330]: DEBUG nova.compute.manager [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Start destroying the instance on the hypervisor. {{(pid=71330) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG nova.compute.manager [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received event network-vif-unplugged-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG nova.compute.manager [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] No waiting events found dispatching network-vif-unplugged-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:38:22 user nova-compute[71330]: DEBUG nova.compute.manager [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received event network-vif-unplugged-985d0774-abf7-42c9-8495-5fdfa488641b for instance with task_state deleting. {{(pid=71330) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [-] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Instance destroyed successfully.
Apr 14 12:38:23 user nova-compute[71330]: DEBUG nova.objects.instance [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'resources' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=71330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG nova.virt.libvirt.vif [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T12:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-176094221',display_name='tempest-AttachVolumeNegativeTest-server-176094221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-176094221',id=47,image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgBt3aXEPux5x/euTPC70vUHsoPtPoWG2MGNlDSeYEqAvM9YUZyQaSt238vYpgnPmWTlfuVMYnPw8Z4ngWNZoWBlflp/CB0g8UzRZyRjFXHa3SvF7GenI77OnMqTAGAew==',key_name='tempest-keypair-509267361',keypairs=<?>,launch_index=0,launched_at=2023-04-14T12:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa90860f65ab408aa00dfd6abb8af18b',ramdisk_id='',reservation_id='r-paeiddn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a84e226d-f438-4fb3-96fe-51f5960a6c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1138909145',owner_user_name='tempest-AttachVolumeNegativeTest-1138909145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T12:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='609f2fce20c44000903c8a05e07ebd67',uuid=1f55e425-e53d-4649-a068-752a764c5629,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converting VIF {"id": "985d0774-abf7-42c9-8495-5fdfa488641b", "address": "fa:16:3e:d8:93:84", "network": {"id": "3d6bc94c-f0fd-4e85-8eab-51fca64de980", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-756290409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa90860f65ab408aa00dfd6abb8af18b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985d0774-ab", "ovs_interfaceid": "985d0774-abf7-42c9-8495-5fdfa488641b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG nova.network.os_vif_util [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:93:84,bridge_name='br-int',has_traffic_filtering=True,id=985d0774-abf7-42c9-8495-5fdfa488641b,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985d0774-ab') {{(pid=71330) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG os_vif [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:93:84,bridge_name='br-int',has_traffic_filtering=True,id=985d0774-abf7-42c9-8495-5fdfa488641b,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985d0774-ab') {{(pid=71330) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap985d0774-ab, bridge=br-int, if_exists=True) {{(pid=71330) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:38:23 user nova-compute[71330]: INFO os_vif [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:93:84,bridge_name='br-int',has_traffic_filtering=True,id=985d0774-abf7-42c9-8495-5fdfa488641b,network=Network(3d6bc94c-f0fd-4e85-8eab-51fca64de980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985d0774-ab')
Apr 14 12:38:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Deleting instance files /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629_del
Apr 14 12:38:23 user nova-compute[71330]: INFO nova.virt.libvirt.driver [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Deletion of /opt/stack/data/nova/instances/1f55e425-e53d-4649-a068-752a764c5629_del complete
Apr 14 12:38:23 user nova-compute[71330]: INFO nova.compute.manager [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 12:38:23 user nova-compute[71330]: DEBUG oslo.service.loopingcall [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71330) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG nova.compute.manager [-] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Deallocating network for instance {{(pid=71330) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 1f55e425-e53d-4649-a068-752a764c5629] deallocate_for_instance() {{(pid=71330) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 12:38:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.network.neutron [-] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Updating instance_info_cache with network_info: [] {{(pid=71330) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 12:38:24 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Took 0.81 seconds to deallocate network for instance.
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Refreshing inventories for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Updating ProviderTree inventory for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Updating inventory in ProviderTree for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Refreshing aggregate associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, aggregates: None {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Refreshing trait associations for resource provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=71330) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:38:24 user nova-compute[71330]: INFO nova.scheduler.client.report [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Deleted allocations for instance 1f55e425-e53d-4649-a068-752a764c5629
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "1f55e425-e53d-4649-a068-752a764c5629" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.188s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received event network-vif-plugged-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] Acquiring lock "1f55e425-e53d-4649-a068-752a764c5629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] Lock "1f55e425-e53d-4649-a068-752a764c5629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] No waiting events found dispatching network-vif-plugged-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 12:38:24 user nova-compute[71330]: WARNING nova.compute.manager [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received unexpected event network-vif-plugged-985d0774-abf7-42c9-8495-5fdfa488641b for instance with vm_state deleted and task_state None.
Apr 14 12:38:24 user nova-compute[71330]: DEBUG nova.compute.manager [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Received event network-vif-deleted-985d0774-abf7-42c9-8495-5fdfa488641b {{(pid=71330) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 12:38:25 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:38:25 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:38:25 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8881MB free_disk=26.213970184326172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:38:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:38:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:38:25 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:38:25 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:38:25 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:38:25 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:38:25 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:38:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:38:26 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:27 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:38:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:38:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:38:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:38:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:38 user nova-compute[71330]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681475903.1526206, 1f55e425-e53d-4649-a068-752a764c5629 => Stopped> {{(pid=71330) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 12:38:38 user nova-compute[71330]: INFO nova.compute.manager [-] [instance: 1f55e425-e53d-4649-a068-752a764c5629] VM Stopped (Lifecycle Event)
Apr 14 12:38:38 user nova-compute[71330]: DEBUG nova.compute.manager [None req-fafa7fab-5744-42c0-a251-8a969348d850 None None] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Checking state {{(pid=71330) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 12:38:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:38:39 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:46 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:38:46 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Cleaning up deleted instances with incomplete migration  {{(pid=71330) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 12:38:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:38:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:38:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:38:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:38:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:38:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:38:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:38:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:38:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:38:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:38:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:39:11 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:39:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:39:11 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 12:39:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:15 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:15 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:15 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:39:16 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:17 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:24 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:39:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:39:24 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:39:24 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:39:25 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:39:25 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:39:25 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=26.21292495727539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:39:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:39:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:39:25 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:39:25 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:39:25 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:39:25 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:39:25 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:39:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:39:25 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:27 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:28 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:39:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:39:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:53 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:39:58 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:40:03 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:40:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:40:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:40:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:40:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:40:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:40:08 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:40:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:40:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Starting heal instance info cache {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 12:40:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Rebuilding the list of instances to heal {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 12:40:12 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Didn't find any instances for network info cache update. {{(pid=71330) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 12:40:12 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:40:13 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:40:16 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:40:17 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:40:17 user nova-compute[71330]: DEBUG nova.compute.manager [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71330) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 12:40:18 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:40:19 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:40:20 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:40:23 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:40:25 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager.update_available_resource {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:40:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:40:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:40:25 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:40:25 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Auditing locally available compute resources for user (node: user) {{(pid=71330) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 12:40:26 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:40:26 user nova-compute[71330]: WARNING nova.virt.libvirt.driver [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 12:40:26 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Hypervisor/Node resource view: name=user free_ram=8903MB free_disk=26.202205657958984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71330) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 12:40:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 12:40:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 12:40:26 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 12:40:26 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71330) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 12:40:26 user nova-compute[71330]: DEBUG nova.compute.provider_tree [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed in ProviderTree for provider: e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 {{(pid=71330) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 12:40:26 user nova-compute[71330]: DEBUG nova.scheduler.client.report [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Inventory has not changed for provider e814bc7e-edf1-4b24-9d9b-8917fa6aa5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71330) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 12:40:26 user nova-compute[71330]: DEBUG nova.compute.resource_tracker [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Compute_service record updated for user:user {{(pid=71330) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 12:40:26 user nova-compute[71330]: DEBUG oslo_concurrency.lockutils [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=71330) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 12:40:28 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:40:28 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:40:29 user nova-compute[71330]: DEBUG oslo_service.periodic_task [None req-cc7b7602-c1ff-4c35-91e1-47a4a0f02d1a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71330) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 12:40:31 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:40:33 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:40:38 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:40:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:40:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 12:40:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71330) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 12:40:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:40:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71330) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 12:40:43 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 12:40:48 user nova-compute[71330]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71330) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}